Max level shown:
1 [ Jan 8 15:17:29 Enabled. ]
2 [ Jan 8 15:17:29 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 8 15:17:29 Method "start" exited with status 0. ]
4 [ Jan 8 15:17:29 Rereading configuration. ]
5 [ Jan 8 15:17:29 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-08T15:17:29.682ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-08T15:17:29.682ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-08T15:17:29.734ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-08T15:17:29.734ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-08T15:17:29.849ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-08T15:17:29.858ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-08T15:17:29.866ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-08T15:17:30.468ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-08T15:17:30.608ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-08T15:17:30.608ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-08T15:17:30.609ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-08T15:17:30.609ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-08T15:17:30.609ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-01-08T15:17:30.609ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-08T15:17:30.612ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-08T15:17:30.612ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-08T15:17:30.612ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-08T15:17:30.612ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-08T15:17:30.612ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-08T15:17:30.612ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-08T15:17:30.612ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-08T15:17:30.612ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-08T15:17:30.612ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-08T15:17:30.624ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-08T15:17:30.624ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool)
322025-01-08T15:17:30.723ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal }
332025-01-08T15:17:31.084ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-08T15:17:31.084ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-08T15:17:31.084ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-08T15:17:31.084ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-08T15:17:31.084ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-08T15:17:31.084ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-08T15:17:31.084ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-08T15:17:31.093ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-08T15:17:31.093ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool)
422025-01-08T15:17:31.180ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal }
432025-01-08T15:17:31.529ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-08T15:17:31.529ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-08T15:17:31.529ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-08T15:17:31.529ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-08T15:17:31.529ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-08T15:17:31.529ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-08T15:17:31.530ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-08T15:17:31.530ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-08T15:17:31.530ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
522025-01-08T15:17:31.530ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552025-01-08T15:17:31.530ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-08T15:17:31.530ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-08T15:17:31.530ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582025-01-08T15:17:31.530ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612025-01-08T15:17:31.530ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-08T15:17:31.530ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-08T15:17:31.530ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-08T15:17:31.530ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-08T15:17:31.530ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-08T15:17:31.530ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-08T15:17:31.530ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-08T15:17:31.530ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-08T15:17:31.530ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-08T15:17:31.530ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
752025-01-08T15:17:31.530ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
762025-01-08T15:17:31.530ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
772025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
782025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
792025-01-08T15:17:31.530ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-08T15:17:31.530ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-01-08T15:17:31.530ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822025-01-08T15:17:31.530ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-01-08T15:17:31.530ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-08T15:17:31.530ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-08T15:17:31.530ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-08T15:17:31.530ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-08T15:17:31.530ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-08T15:17:31.530ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-08T15:17:31.530ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-08T15:17:31.530ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-01-08T15:17:31.530ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
962025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
972025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
982025-01-08T15:17:31.530ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-08T15:17:31.530ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002025-01-08T15:17:31.530ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-01-08T15:17:31.530ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-01-08T15:17:31.530ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-08T15:17:31.530ZINFOSledAgent (bootstore): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-08T15:17:31.530ZINFOSledAgent (bootstore): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-08T15:17:31.530ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-08T15:17:31.530ZINFOSledAgent (bootstore): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-08T15:17:31.530ZINFOSledAgent (bootstore): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-08T15:17:31.530ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-08T15:17:31.530ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-08T15:17:31.530ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-08T15:17:31.541ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:748
1132025-01-08T15:17:31.541ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 37215, tv_nsec: 844864611 } time_to_next_cleanup = 599.999917988s
1142025-01-08T15:17:31.542ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
1152025-01-08T15:17:31.542ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-08T15:17:31.542ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-08T15:17:31.542ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-08T15:17:31.545ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-08T15:17:31.547ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-08T15:17:31.547ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-08T15:17:31.547ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-08T15:17:31.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-08T15:17:31.547ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-08T15:17:31.547ZINFOSledAgent (RSS): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-08T15:17:31.547ZINFOSledAgent (RSS): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-08T15:17:31.547ZINFOSledAgent (RSS): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-08T15:17:31.547ZINFOSledAgent (RSS): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-08T15:17:31.547ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-08T15:17:31.547ZINFOSledAgent (RSS): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-08T15:17:31.548ZINFOSledAgent (RSS): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-08T15:17:31.548ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-08T15:17:31.548ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-08T15:17:31.548ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-08T15:17:31.548ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-08T15:17:31.548ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-08T15:17:31.548ZINFOSledAgent (bootstore): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-08T15:17:31.548ZINFOSledAgent (bootstore): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-08T15:17:31.548ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-08T15:17:31.548ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ba54f0e2-bde0-4da7-a58e-566dc5903c14 (sled), rack_id: fa7d62e1-57d8-49cc-9dd2-a5f8873ea528, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-08T15:17:31.549ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4270
1412025-01-08T15:17:31.549ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4664
1422025-01-08T15:17:31.554ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-08T15:17:31.559ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-08T15:17:31.559ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-08T15:17:31.564ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-08T15:17:31.564ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-08T15:17:31.564ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:43731
1482025-01-08T15:17:31.564ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: ba54f0e2-bde0-4da7-a58e-566dc5903c14 (sled), rack_id: fa7d62e1-57d8-49cc-9dd2-a5f8873ea528, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-08T15:17:31.564ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-08T15:17:31.564ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-08T15:17:31.564ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-08T15:17:31.564ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-08T15:17:31.564ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-08T15:17:31.564ZINFOSledAgent (StorageManager): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-08T15:17:31.564ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562025-01-08T15:17:31.564ZINFOSledAgent (StorageManager): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-08T15:17:31.564ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-08T15:17:31.564ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-08T15:17:31.564ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-08T15:17:31.564ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-08T15:17:31.564ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-08T15:17:31.581ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-08T15:17:31.602ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-08T15:17:31.619ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-08T15:17:31.628ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
1662025-01-08T15:17:31.628ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-08T15:17:31.628ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
1682025-01-08T15:17:31.628ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-08T15:17:31.630ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 124.531787ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "864a4e3c-4d57-43ac-b5ca-7de719ee52b7", "content-length": "124", "date": "Wed, 08 Jan 2025 15:17:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "864a4e3c-4d57-43ac-b5ca-7de719ee52b7" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-08T15:17:31.641ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_580ac96a-ea6a-49c2-9023-080ed7bbaec9/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-08T15:17:31.663ZINFOSledAgent: successfully created encrypted zvol: name="oxi_580ac96a-ea6a-49c2-9023-080ed7bbaec9/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-08T15:17:31.663ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_580ac96a-ea6a-49c2-9023-080ed7bbaec9/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-08T15:17:31.669ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
1742025-01-08T15:17:31.669ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-08T15:17:31.669ZINFOSledAgent (BackingFs): Ensuring dataset oxi_580ac96a-ea6a-49c2-9023-080ed7bbaec9/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-08T15:17:31.741ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-01-08T15:17:31.757ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782025-01-08T15:17:31.757ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 74.615844ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "563609a2-254b-4ce8-8e20-4c755b9c4889", "content-length": "124", "date": "Wed, 08 Jan 2025 15:17:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "563609a2-254b-4ce8-8e20-4c755b9c4889" } file = clients/ddm-admin-client/src/lib.rs:177
1792025-01-08T15:17:31.833ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-08T15:17:31.834ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 153.174184ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9de5ab3a-de3f-45ab-95cc-2cae07117d04", "content-length": "124", "date": "Wed, 08 Jan 2025 15:17:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9de5ab3a-de3f-45ab-95cc-2cae07117d04" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-08T15:17:31.959ZINFOSledAgent (BackingFs): Mounting oxi_580ac96a-ea6a-49c2-9023-080ed7bbaec9/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-08T15:17:31.972ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-08T15:17:31.972ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-08T15:17:31.972ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-08T15:17:31.973ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-08T15:17:31.989ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-08T15:17:31.989ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 225.499662ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dbf8e535-b534-4b2b-b608-939be09c441b", "content-length": "124", "date": "Wed, 08 Jan 2025 15:17:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dbf8e535-b534-4b2b-b608-939be09c441b" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-08T15:17:32.216ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-08T15:17:32.217ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 268.909631ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cfe19970-6fda-4c0f-8ac6-9eddcad8c2bf", "content-length": "124", "date": "Wed, 08 Jan 2025 15:17:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cfe19970-6fda-4c0f-8ac6-9eddcad8c2bf" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-08T15:17:32.487ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-08T15:17:32.487ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 163.60015ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9f97f1a3-fa74-4cde-8e4b-828c75cdac39", "content-length": "124", "date": "Wed, 08 Jan 2025 15:17:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9f97f1a3-fa74-4cde-8e4b-828c75cdac39" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-08T15:17:32.652ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-08T15:17:32.653ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 435.330666ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "437e893f-0a7f-4c75-af5e-ce5065583ca1", "content-length": "124", "date": "Wed, 08 Jan 2025 15:17:32 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "437e893f-0a7f-4c75-af5e-ce5065583ca1" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-08T15:17:32.700ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
1952025-01-08T15:17:32.705ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:57921 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
1962025-01-08T15:17:32.706ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
1972025-01-08T15:17:32.706ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:57921 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
1982025-01-08T15:17:32.707ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 360.320973ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
1992025-01-08T15:17:32.707ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2002025-01-08T15:17:32.707ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2012025-01-08T15:17:32.708ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:932 underlay_address = fd00:1122:3344:101::1
2022025-01-08T15:17:32.708ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-08T15:17:33.069ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 412.646016ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2042025-01-08T15:17:33.089ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2052025-01-08T15:17:33.484ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.193381344s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2062025-01-08T15:17:34.679ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.281530203s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2072025-01-08T15:17:35.249ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2694
2082025-01-08T15:17:35.249ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2939
2092025-01-08T15:17:35.249ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2564
2102025-01-08T15:17:35.249ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2611
2112025-01-08T15:17:35.249ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3020
2122025-01-08T15:17:35.249ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3065
2132025-01-08T15:17:35.251ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2864
2142025-01-08T15:17:35.252ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2605
2152025-01-08T15:17:35.252ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='89e58b24-69fa-48cb-89a7-c60fedd5f16e'/> <propval type="astring" name="rack_id" value='fa7d62e1-57d8-49cc-9dd2-a5f8873ea528'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe38:d4d5'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='fa7d62e1-57d8-49cc-9dd2-a5f8873ea528'/> <propval type="astring" name="sled_id" value='ba54f0e2-bde0-4da7-a58e-566dc5903c14'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='ba54f0e2-bde0-4da7-a58e-566dc5903c14'/> <propval type="astring" name="rack_uuid" value='fa7d62e1-57d8-49cc-9dd2-a5f8873ea528'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='ba54f0e2-bde0-4da7-a58e-566dc5903c14'/> <propval type="astring" name="rack_uuid" value='fa7d62e1-57d8-49cc-9dd2-a5f8873ea528'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-08T15:17:35.253ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-08T15:17:35.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 35.1327ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182025-01-08T15:17:35.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 60.201762ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192025-01-08T15:17:35.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 222.551889ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-08T15:17:35.962ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.549189501s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2212025-01-08T15:17:36.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 362.118085ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222025-01-08T15:17:36.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 638.96716ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232025-01-08T15:17:37.441ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 704.894562ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-08T15:17:38.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 734.091422ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252025-01-08T15:17:38.513ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 8.120407585s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2262025-01-08T15:17:39.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 972.534218ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272025-01-08T15:17:40.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 859.046792ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2282025-01-08T15:17:41.691ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/ba54f0e2-bde0-4da7-a58e-566dc5903c14) file = sled-agent/src/nexus.rs:527 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2292025-01-08T15:17:41.721ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302025-01-08T15:17:41.721ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2312025-01-08T15:17:41.723ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2322025-01-08T15:17:41.723ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2332025-01-08T15:17:41.723ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2342025-01-08T15:17:41.723ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-01-08T15:17:41.723ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2362025-01-08T15:17:41.723ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2372025-01-08T15:17:41.723ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2382025-01-08T15:17:41.723ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
2392025-01-08T15:17:41.723ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:43731
2402025-01-08T15:17:41.915ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2412025-01-08T15:17:41.915ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2422025-01-08T15:17:41.921ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4294 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2432025-01-08T15:17:42.894ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14) file = sled-agent/src/probe_manager.rs:231 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2442025-01-08T15:17:42.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59490
2452025-01-08T15:17:42.894ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4213946498897678202 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2462025-01-08T15:17:42.894ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5916213442440478333 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2472025-01-08T15:17:42.895ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2482025-01-08T15:17:42.895ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2492025-01-08T15:17:42.895ZINFOSledAgent (ServiceManager): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:188
2502025-01-08T15:17:42.895ZINFOSledAgent (ServiceManager): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:188
2512025-01-08T15:17:42.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59490 req_id = d7e8c4b5-e9a2-4795-a1c2-a1c45e34ddf3 response_code = 200 uri = /inventory
2522025-01-08T15:17:43.123ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2532025-01-08T15:17:43.131ZINFOSledAgent (ServiceManager): refreshed zone-network-setup service with new configuration file = sled-agent/src/services.rs:4343
2542025-01-08T15:17:43.131ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4401
2552025-01-08T15:17:43.159ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61534
2562025-01-08T15:17:43.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61534 req_id = cea290ef-593d-41be-b2be-dcd242b05125 response_code = 200 uri = /sled-role
2572025-01-08T15:17:43.201ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 1c367311-4c5e-49a8-800d-0ffe0dd959ca (physical_disk), pool_id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e77956c2-15f1-46f1-8264-1ffe9d7fe3cd (physical_disk), pool_id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a2d814cb-dac2-4a23-8480-bdf6b598aea0 (physical_disk), pool_id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ab683586-54df-4fa7-a10b-fb2074901db9 (physical_disk), pool_id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 908ae750-44b4-481c-8012-6e700dc94b05 (physical_disk), pool_id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 6e80430a-2fa8-43ac-9446-08b2937230f7 (physical_disk), pool_id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 57e4126d-388b-49a2-aba4-362ded1f2069 (physical_disk), pool_id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 48792179-f962-42bf-a5b1-570acd105aca (physical_disk), pool_id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 2d308cbb-880d-4e18-b0f0-d086f0b51bf5 (physical_disk), pool_id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2582025-01-08T15:17:43.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42348
2592025-01-08T15:17:43.201ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
2602025-01-08T15:17:43.202ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 1c367311-4c5e-49a8-800d-0ffe0dd959ca (physical_disk), pool_id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e77956c2-15f1-46f1-8264-1ffe9d7fe3cd (physical_disk), pool_id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: a2d814cb-dac2-4a23-8480-bdf6b598aea0 (physical_disk), pool_id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ab683586-54df-4fa7-a10b-fb2074901db9 (physical_disk), pool_id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 908ae750-44b4-481c-8012-6e700dc94b05 (physical_disk), pool_id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 6e80430a-2fa8-43ac-9446-08b2937230f7 (physical_disk), pool_id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 57e4126d-388b-49a2-aba4-362ded1f2069 (physical_disk), pool_id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 48792179-f962-42bf-a5b1-570acd105aca (physical_disk), pool_id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 2d308cbb-880d-4e18-b0f0-d086f0b51bf5 (physical_disk), pool_id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2612025-01-08T15:17:43.202ZINFOSledAgent (StorageManager): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2622025-01-08T15:17:43.202ZINFOSledAgent (StorageManager): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2632025-01-08T15:17:43.202ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2642025-01-08T15:17:43.202ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2652025-01-08T15:17:43.202ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2662025-01-08T15:17:43.202ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2672025-01-08T15:17:43.202ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2682025-01-08T15:17:43.212ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2692025-01-08T15:17:43.212ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2bc669d0-0094-4137-bc22-36487a33d705 (zpool)
2702025-01-08T15:17:43.307ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }
2712025-01-08T15:17:43.314ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2722025-01-08T15:17:43.314ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2732025-01-08T15:17:43.314ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2742025-01-08T15:17:43.315ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2752025-01-08T15:17:43.315ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762025-01-08T15:17:43.315ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772025-01-08T15:17:43.315ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2782025-01-08T15:17:43.351ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2792025-01-08T15:17:43.359ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone file = sled-storage/src/dataset.rs:302
2802025-01-08T15:17:43.496ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2bc669d0-0094-4137-bc22-36487a33d705 file = sled-storage/src/dataset.rs:388
2812025-01-08T15:17:43.504ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2822025-01-08T15:17:43.504ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2832025-01-08T15:17:43.504ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2842025-01-08T15:17:43.505ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2852025-01-08T15:17:43.505ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2862025-01-08T15:17:43.514ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2872025-01-08T15:17:43.514ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool)
2882025-01-08T15:17:43.606ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }
2892025-01-08T15:17:43.616ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2902025-01-08T15:17:43.616ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2912025-01-08T15:17:43.616ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2922025-01-08T15:17:43.616ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2932025-01-08T15:17:43.616ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942025-01-08T15:17:43.616ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952025-01-08T15:17:43.616ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2962025-01-08T15:17:43.650ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2972025-01-08T15:17:43.658ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone file = sled-storage/src/dataset.rs:302
2982025-01-08T15:17:43.796ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b68c2a96-30ec-49d6-a55f-078a6befe678 file = sled-storage/src/dataset.rs:388
2992025-01-08T15:17:43.804ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3002025-01-08T15:17:43.804ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3012025-01-08T15:17:43.804ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3022025-01-08T15:17:43.804ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3032025-01-08T15:17:43.804ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3042025-01-08T15:17:43.814ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3052025-01-08T15:17:43.814ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool)
3062025-01-08T15:17:43.909ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }
3072025-01-08T15:17:43.917ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3082025-01-08T15:17:43.917ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3092025-01-08T15:17:43.917ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3102025-01-08T15:17:43.917ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3112025-01-08T15:17:43.917ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122025-01-08T15:17:43.918ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132025-01-08T15:17:43.918ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3142025-01-08T15:17:43.921ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14) file = sled-agent/src/probe_manager.rs:231 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
3152025-01-08T15:17:43.953ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3162025-01-08T15:17:43.961ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone file = sled-storage/src/dataset.rs:302
3172025-01-08T15:17:44.097ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 file = sled-storage/src/dataset.rs:388
3182025-01-08T15:17:44.104ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3192025-01-08T15:17:44.105ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3202025-01-08T15:17:44.105ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3212025-01-08T15:17:44.105ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3222025-01-08T15:17:44.105ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232025-01-08T15:17:44.114ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3242025-01-08T15:17:44.114ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2838adfd-6724-4d11-9727-968f07762cf0 (zpool)
3252025-01-08T15:17:44.205ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }
3262025-01-08T15:17:44.213ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3272025-01-08T15:17:44.213ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3282025-01-08T15:17:44.213ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3292025-01-08T15:17:44.213ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3302025-01-08T15:17:44.213ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312025-01-08T15:17:44.213ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322025-01-08T15:17:44.213ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3332025-01-08T15:17:44.250ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3342025-01-08T15:17:44.258ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2838adfd-6724-4d11-9727-968f07762cf0/crypt/zone file = sled-storage/src/dataset.rs:302
3352025-01-08T15:17:44.403ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2838adfd-6724-4d11-9727-968f07762cf0 file = sled-storage/src/dataset.rs:388
3362025-01-08T15:17:44.412ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3372025-01-08T15:17:44.412ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3382025-01-08T15:17:44.412ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3392025-01-08T15:17:44.412ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402025-01-08T15:17:44.412ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412025-01-08T15:17:44.421ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3422025-01-08T15:17:44.422ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool)
3432025-01-08T15:17:44.518ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }
3442025-01-08T15:17:44.527ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3452025-01-08T15:17:44.527ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3462025-01-08T15:17:44.527ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3472025-01-08T15:17:44.527ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3482025-01-08T15:17:44.527ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492025-01-08T15:17:44.527ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502025-01-08T15:17:44.527ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3512025-01-08T15:17:44.561ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522025-01-08T15:17:44.569ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/zone file = sled-storage/src/dataset.rs:302
3532025-01-08T15:17:44.712ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f80f84fb-0d35-46c9-a329-b7397a036f55 file = sled-storage/src/dataset.rs:388
3542025-01-08T15:17:44.720ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3552025-01-08T15:17:44.720ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3562025-01-08T15:17:44.720ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3572025-01-08T15:17:44.720ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582025-01-08T15:17:44.720ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592025-01-08T15:17:44.730ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3602025-01-08T15:17:44.730ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool)
3612025-01-08T15:17:44.823ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }
3622025-01-08T15:17:44.832ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3632025-01-08T15:17:44.832ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3642025-01-08T15:17:44.832ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3652025-01-08T15:17:44.832ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3662025-01-08T15:17:44.832ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672025-01-08T15:17:44.832ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682025-01-08T15:17:44.832ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3692025-01-08T15:17:44.867ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3702025-01-08T15:17:44.876ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46/crypt/zone file = sled-storage/src/dataset.rs:302
3712025-01-08T15:17:44.924ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14) file = sled-agent/src/probe_manager.rs:231 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
3722025-01-08T15:17:45.014ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46 file = sled-storage/src/dataset.rs:388
3732025-01-08T15:17:45.021ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3742025-01-08T15:17:45.021ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3752025-01-08T15:17:45.021ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3762025-01-08T15:17:45.021ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3772025-01-08T15:17:45.021ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3782025-01-08T15:17:45.031ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3792025-01-08T15:17:45.031ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool)
3802025-01-08T15:17:45.130ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }
3812025-01-08T15:17:45.138ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3822025-01-08T15:17:45.139ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3832025-01-08T15:17:45.139ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3842025-01-08T15:17:45.139ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3852025-01-08T15:17:45.139ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862025-01-08T15:17:45.139ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872025-01-08T15:17:45.139ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3882025-01-08T15:17:45.175ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892025-01-08T15:17:45.183ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/zone file = sled-storage/src/dataset.rs:302
3902025-01-08T15:17:45.324ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 file = sled-storage/src/dataset.rs:388
3912025-01-08T15:17:45.332ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922025-01-08T15:17:45.332ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932025-01-08T15:17:45.332ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942025-01-08T15:17:45.332ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952025-01-08T15:17:45.332ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962025-01-08T15:17:45.341ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3972025-01-08T15:17:45.341ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool)
3982025-01-08T15:17:45.438ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }
3992025-01-08T15:17:45.446ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4002025-01-08T15:17:45.446ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4012025-01-08T15:17:45.446ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4022025-01-08T15:17:45.446ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4032025-01-08T15:17:45.446ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042025-01-08T15:17:45.446ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052025-01-08T15:17:45.446ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4062025-01-08T15:17:45.484ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072025-01-08T15:17:45.492ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/zone file = sled-storage/src/dataset.rs:302
4082025-01-08T15:17:45.634ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae file = sled-storage/src/dataset.rs:388
4092025-01-08T15:17:45.642ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4102025-01-08T15:17:45.642ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4112025-01-08T15:17:45.642ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4122025-01-08T15:17:45.642ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4132025-01-08T15:17:45.642ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4142025-01-08T15:17:45.653ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4152025-01-08T15:17:45.653ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool)
4162025-01-08T15:17:45.754ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }
4172025-01-08T15:17:45.763ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4182025-01-08T15:17:45.763ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4192025-01-08T15:17:45.763ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4202025-01-08T15:17:45.763ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4212025-01-08T15:17:45.763ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4222025-01-08T15:17:45.763ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232025-01-08T15:17:45.763ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4242025-01-08T15:17:45.799ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4252025-01-08T15:17:45.807ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crypt/zone file = sled-storage/src/dataset.rs:302
4262025-01-08T15:17:45.925ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14) file = sled-agent/src/probe_manager.rs:231 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4272025-01-08T15:17:45.948ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a file = sled-storage/src/dataset.rs:388
4282025-01-08T15:17:45.955ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4292025-01-08T15:17:45.955ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4302025-01-08T15:17:45.955ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-01-08T15:17:45.955ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 580ac96a-ea6a-49c2-9023-080ed7bbaec9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4322025-01-08T15:17:45.955ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4332025-01-08T15:17:45.955ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4342025-01-08T15:17:45.956ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352025-01-08T15:17:45.956ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4362025-01-08T15:17:45.956ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4372025-01-08T15:17:45.956ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4382025-01-08T15:17:45.956ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4392025-01-08T15:17:45.956ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4402025-01-08T15:17:45.956ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4412025-01-08T15:17:45.956ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4422025-01-08T15:17:45.956ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4432025-01-08T15:17:45.956ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4442025-01-08T15:17:45.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2754775 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:42348 req_id = ea43fe93-39fd-4dcc-b92d-c4ea747211b5 response_code = 200 uri = /omicron-physical-disks
4452025-01-08T15:17:45.988ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0111169a-5567-48ec-b307-7c3b347db8f9 (dataset): DatasetConfig { id: 0111169a-5567-48ec-b307-7c3b347db8f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04db722a-5424-4050-b08e-fcb829915274 (dataset): DatasetConfig { id: 04db722a-5424-4050-b08e-fcb829915274 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06f9f3fa-0def-4b3e-8c74-5cd862782333 (dataset): DatasetConfig { id: 06f9f3fa-0def-4b3e-8c74-5cd862782333 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 180b0b95-c5dd-474f-ab5f-6037e7ed0ef5 (dataset): DatasetConfig { id: 180b0b95-c5dd-474f-ab5f-6037e7ed0ef5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ad9e66a-f0c0-4a02-a5bb-57d60f456b7d (dataset): DatasetConfig { id: 1ad9e66a-f0c0-4a02-a5bb-57d60f456b7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2645ae3e-dd97-4302-91dc-a41ba2937c71 (dataset): DatasetConfig { id: 2645ae3e-dd97-4302-91dc-a41ba2937c71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29d405c3-b3c6-47d2-9129-cfbd0879d337 (dataset): DatasetConfig { id: 29d405c3-b3c6-47d2-9129-cfbd0879d337 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2c3e397d-b6f4-4abd-9e5d-170303519a55 (dataset): DatasetConfig { id: 2c3e397d-b6f4-4abd-9e5d-170303519a55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33f1bf8b-674e-4c66-98da-1623766a6a11 (dataset): DatasetConfig { id: 33f1bf8b-674e-4c66-98da-1623766a6a11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f2f0fbf-264e-4eaa-a6ac-7fe8979ac95c (dataset): DatasetConfig { id: 3f2f0fbf-264e-4eaa-a6ac-7fe8979ac95c (dataset), name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 403695e1-d289-46d5-a36a-d2f3c2d3e5aa (dataset): DatasetConfig { id: 403695e1-d289-46d5-a36a-d2f3c2d3e5aa (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49bcf0d6-6067-4a4d-b173-2808d2e4d3c1 (dataset): DatasetConfig { id: 49bcf0d6-6067-4a4d-b173-2808d2e4d3c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4abb4403-31a8-482c-8924-91b1c928de81 (dataset): DatasetConfig { id: 4abb4403-31a8-482c-8924-91b1c928de81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e9cf450-ddcb-447f-a50b-673007f14aae (dataset): DatasetConfig { id: 4e9cf450-ddcb-447f-a50b-673007f14aae (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 500c3151-474e-4a10-b169-cf6a37423760 (dataset): DatasetConfig { id: 500c3151-474e-4a10-b169-cf6a37423760 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 57074acd-1dd9-42c7-abf2-30611f4d86e1 (dataset): DatasetConfig { id: 57074acd-1dd9-42c7-abf2-30611f4d86e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b4599c5-1334-4149-a1cc-c94122910704 (dataset): DatasetConfig { id: 5b4599c5-1334-4149-a1cc-c94122910704 (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c53bc77-aa20-4c13-9436-de5162b431bf (dataset): DatasetConfig { id: 5c53bc77-aa20-4c13-9436-de5162b431bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cc4f19d-92ad-4cf9-afec-d1d6ae0f28de (dataset): DatasetConfig { id: 5cc4f19d-92ad-4cf9-afec-d1d6ae0f28de (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f7c9aed-2f23-4a2c-abef-65f35d8f9f35 (dataset): DatasetConfig { id: 5f7c9aed-2f23-4a2c-abef-65f35d8f9f35 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 616f0aea-8792-4224-97d9-4fe114c47079 (dataset): DatasetConfig { id: 616f0aea-8792-4224-97d9-4fe114c47079 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 61f2d3ac-52ac-451e-93f3-4cb29119aa7e (dataset): DatasetConfig { id: 61f2d3ac-52ac-451e-93f3-4cb29119aa7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6537f99f-b2dc-494d-a61f-f7a2a4b232b2 (dataset): DatasetConfig { id: 6537f99f-b2dc-494d-a61f-f7a2a4b232b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6789e44e-0c1d-4bae-9ce3-4ce2f3889ef1 (dataset): DatasetConfig { id: 6789e44e-0c1d-4bae-9ce3-4ce2f3889ef1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6863dc3c-bcf9-4cc2-adea-8bec89ceef71 (dataset): DatasetConfig { id: 6863dc3c-bcf9-4cc2-adea-8bec89ceef71 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 689186fa-4dc5-407d-a32b-ca0849aabbc1 (dataset): DatasetConfig { id: 689186fa-4dc5-407d-a32b-ca0849aabbc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f445ce7-8feb-4e7a-9434-b1c47ef561ad (dataset): DatasetConfig { id: 6f445ce7-8feb-4e7a-9434-b1c47ef561ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a7b530a-ab69-4212-9cbe-12a70e63ecf1 (dataset): DatasetConfig { id: 7a7b530a-ab69-4212-9cbe-12a70e63ecf1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ad00de1-13f5-4b21-9f7d-69855b4e00f7 (dataset): DatasetConfig { id: 7ad00de1-13f5-4b21-9f7d-69855b4e00f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b0d1c4d-5e9e-4914-8b03-d76d46909499 (dataset): DatasetConfig { id: 7b0d1c4d-5e9e-4914-8b03-d76d46909499 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7db41b11-250a-408e-9925-6b1c3f152549 (dataset): DatasetConfig { id: 7db41b11-250a-408e-9925-6b1c3f152549 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e05bce3-e10e-41e3-8ff3-79e6062bb004 (dataset): DatasetConfig { id: 7e05bce3-e10e-41e3-8ff3-79e6062bb004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f58def9-4481-4e54-85c8-27eecc478afb (dataset): DatasetConfig { id: 7f58def9-4481-4e54-85c8-27eecc478afb (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8012c335-6686-44eb-ad85-40239ae1b5af (dataset): DatasetConfig { id: 8012c335-6686-44eb-ad85-40239ae1b5af (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 806f782f-8e86-487f-b147-2c79c767105a (dataset): DatasetConfig { id: 806f782f-8e86-487f-b147-2c79c767105a (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82578f61-cc0d-4757-88a9-dc16fdbd795e (dataset): DatasetConfig { id: 82578f61-cc0d-4757-88a9-dc16fdbd795e (dataset), name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 854a3b3e-822d-4d2d-8c9c-2f299213817f (dataset): DatasetConfig { id: 854a3b3e-822d-4d2d-8c9c-2f299213817f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 86cd000d-434e-48f1-8422-53f74bef12a9 (dataset): DatasetConfig { id: 86cd000d-434e-48f1-8422-53f74bef12a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ab90a49-d39c-4329-aca7-15bc8fcdab15 (dataset): DatasetConfig { id: 8ab90a49-d39c-4329-aca7-15bc8fcdab15 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dee6759-f358-4822-a25f-7c6f95041b00 (dataset): DatasetConfig { id: 8dee6759-f358-4822-a25f-7c6f95041b00 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9420eeed-ede0-4fd4-8854-abf5cf06d9d6 (dataset): DatasetConfig { id: 9420eeed-ede0-4fd4-8854-abf5cf06d9d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9562f0df-fda3-4526-817c-08c1846d64e6 (dataset): DatasetConfig { id: 9562f0df-fda3-4526-817c-08c1846d64e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa4393c7-7c1c-419b-9bc4-a50f58b87094 (dataset): DatasetConfig { id: aa4393c7-7c1c-419b-9bc4-a50f58b87094 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1fbace0-083e-4a3b-a533-faa585bc9821 (dataset): DatasetConfig { id: b1fbace0-083e-4a3b-a533-faa585bc9821 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3d403d7-5ce7-4309-ae79-97a1a8854865 (dataset): DatasetConfig { id: b3d403d7-5ce7-4309-ae79-97a1a8854865 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc14e274-ad22-45e6-b484-8f966376dca9 (dataset): DatasetConfig { id: bc14e274-ad22-45e6-b484-8f966376dca9 (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bcb64b3b-921a-4e76-aaf0-e0a853b2d956 (dataset): DatasetConfig { id: bcb64b3b-921a-4e76-aaf0-e0a853b2d956 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be894ba2-2ba1-4bc3-ac24-cfac8246b0e6 (dataset): DatasetConfig { id: be894ba2-2ba1-4bc3-ac24-cfac8246b0e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7bffcc7-7fbe-42d6-ba8a-55481404ab9e (dataset): DatasetConfig { id: c7bffcc7-7fbe-42d6-ba8a-55481404ab9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c85f45df-07e1-4930-ab91-5331a45c0147 (dataset): DatasetConfig { id: c85f45df-07e1-4930-ab91-5331a45c0147 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1dd1157-2c9f-4292-b41b-2b728c7ca700 (dataset): DatasetConfig { id: d1dd1157-2c9f-4292-b41b-2b728c7ca700 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9fdead0-f3b5-478b-94d6-0c98c36be40b (dataset): DatasetConfig { id: d9fdead0-f3b5-478b-94d6-0c98c36be40b (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da0e4ebe-488c-47c4-8ee2-656e5b9ee4cf (dataset): DatasetConfig { id: da0e4ebe-488c-47c4-8ee2-656e5b9ee4cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddead89e-0465-4599-b8f8-556dcd3b0bd0 (dataset): DatasetConfig { id: ddead89e-0465-4599-b8f8-556dcd3b0bd0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de910bb1-cbad-45b8-a0b3-4ecb0e8837d4 (dataset): DatasetConfig { id: de910bb1-cbad-45b8-a0b3-4ecb0e8837d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2b03a75-e5a2-4279-9682-115cc246468a (dataset): DatasetConfig { id: e2b03a75-e5a2-4279-9682-115cc246468a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e658f38c-dbdc-4a2b-84a1-9364fa862ae0 (dataset): DatasetConfig { id: e658f38c-dbdc-4a2b-84a1-9364fa862ae0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb55dc02-b291-4f13-9c7f-f445eb18b893 (dataset): DatasetConfig { id: eb55dc02-b291-4f13-9c7f-f445eb18b893 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ef33b084-b829-424f-b683-bad673caa8cc (dataset): DatasetConfig { id: ef33b084-b829-424f-b683-bad673caa8cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efa90dea-53eb-4885-b98d-8ba811a3f49b (dataset): DatasetConfig { id: efa90dea-53eb-4885-b98d-8ba811a3f49b (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0e67934-e6e6-42cd-9339-d8e71175cd82 (dataset): DatasetConfig { id: f0e67934-e6e6-42cd-9339-d8e71175cd82 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f24f0ac3-f266-4fee-b6f5-ddf3faf9fe2d (dataset): DatasetConfig { id: f24f0ac3-f266-4fee-b6f5-ddf3faf9fe2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f61afb7a-2a48-457c-b9d4-7a366790c6fa (dataset): DatasetConfig { id: f61afb7a-2a48-457c-b9d4-7a366790c6fa (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6356de8-96f5-4a93-a961-cfae31f23e6e (dataset): DatasetConfig { id: f6356de8-96f5-4a93-a961-cfae31f23e6e (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f787225e-6126-4688-8292-b42eae551bab (dataset): DatasetConfig { id: f787225e-6126-4688-8292-b42eae551bab (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7cde5e9-1469-4cee-8b58-50bb4bf31b38 (dataset): DatasetConfig { id: f7cde5e9-1469-4cee-8b58-50bb4bf31b38 (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4462025-01-08T15:17:45.988ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33032
4472025-01-08T15:17:45.988ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4482025-01-08T15:17:45.989ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0111169a-5567-48ec-b307-7c3b347db8f9 (dataset): DatasetConfig { id: 0111169a-5567-48ec-b307-7c3b347db8f9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04db722a-5424-4050-b08e-fcb829915274 (dataset): DatasetConfig { id: 04db722a-5424-4050-b08e-fcb829915274 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06f9f3fa-0def-4b3e-8c74-5cd862782333 (dataset): DatasetConfig { id: 06f9f3fa-0def-4b3e-8c74-5cd862782333 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 180b0b95-c5dd-474f-ab5f-6037e7ed0ef5 (dataset): DatasetConfig { id: 180b0b95-c5dd-474f-ab5f-6037e7ed0ef5 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ad9e66a-f0c0-4a02-a5bb-57d60f456b7d (dataset): DatasetConfig { id: 1ad9e66a-f0c0-4a02-a5bb-57d60f456b7d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2645ae3e-dd97-4302-91dc-a41ba2937c71 (dataset): DatasetConfig { id: 2645ae3e-dd97-4302-91dc-a41ba2937c71 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 29d405c3-b3c6-47d2-9129-cfbd0879d337 (dataset): DatasetConfig { id: 29d405c3-b3c6-47d2-9129-cfbd0879d337 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 2c3e397d-b6f4-4abd-9e5d-170303519a55 (dataset): DatasetConfig { id: 2c3e397d-b6f4-4abd-9e5d-170303519a55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 33f1bf8b-674e-4c66-98da-1623766a6a11 (dataset): DatasetConfig { id: 33f1bf8b-674e-4c66-98da-1623766a6a11 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3f2f0fbf-264e-4eaa-a6ac-7fe8979ac95c (dataset): DatasetConfig { id: 3f2f0fbf-264e-4eaa-a6ac-7fe8979ac95c (dataset), name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 403695e1-d289-46d5-a36a-d2f3c2d3e5aa (dataset): DatasetConfig { id: 403695e1-d289-46d5-a36a-d2f3c2d3e5aa (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 49bcf0d6-6067-4a4d-b173-2808d2e4d3c1 (dataset): DatasetConfig { id: 49bcf0d6-6067-4a4d-b173-2808d2e4d3c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4abb4403-31a8-482c-8924-91b1c928de81 (dataset): DatasetConfig { id: 4abb4403-31a8-482c-8924-91b1c928de81 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e9cf450-ddcb-447f-a50b-673007f14aae (dataset): DatasetConfig { id: 4e9cf450-ddcb-447f-a50b-673007f14aae (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 500c3151-474e-4a10-b169-cf6a37423760 (dataset): DatasetConfig { id: 500c3151-474e-4a10-b169-cf6a37423760 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 57074acd-1dd9-42c7-abf2-30611f4d86e1 (dataset): DatasetConfig { id: 57074acd-1dd9-42c7-abf2-30611f4d86e1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b4599c5-1334-4149-a1cc-c94122910704 (dataset): DatasetConfig { id: 5b4599c5-1334-4149-a1cc-c94122910704 (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c53bc77-aa20-4c13-9436-de5162b431bf (dataset): DatasetConfig { id: 5c53bc77-aa20-4c13-9436-de5162b431bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5cc4f19d-92ad-4cf9-afec-d1d6ae0f28de (dataset): DatasetConfig { id: 5cc4f19d-92ad-4cf9-afec-d1d6ae0f28de (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f7c9aed-2f23-4a2c-abef-65f35d8f9f35 (dataset): DatasetConfig { id: 5f7c9aed-2f23-4a2c-abef-65f35d8f9f35 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 616f0aea-8792-4224-97d9-4fe114c47079 (dataset): DatasetConfig { id: 616f0aea-8792-4224-97d9-4fe114c47079 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 61f2d3ac-52ac-451e-93f3-4cb29119aa7e (dataset): DatasetConfig { id: 61f2d3ac-52ac-451e-93f3-4cb29119aa7e (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6537f99f-b2dc-494d-a61f-f7a2a4b232b2 (dataset): DatasetConfig { id: 6537f99f-b2dc-494d-a61f-f7a2a4b232b2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6789e44e-0c1d-4bae-9ce3-4ce2f3889ef1 (dataset): DatasetConfig { id: 6789e44e-0c1d-4bae-9ce3-4ce2f3889ef1 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6863dc3c-bcf9-4cc2-adea-8bec89ceef71 (dataset): DatasetConfig { id: 6863dc3c-bcf9-4cc2-adea-8bec89ceef71 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 689186fa-4dc5-407d-a32b-ca0849aabbc1 (dataset): DatasetConfig { id: 689186fa-4dc5-407d-a32b-ca0849aabbc1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f445ce7-8feb-4e7a-9434-b1c47ef561ad (dataset): DatasetConfig { id: 6f445ce7-8feb-4e7a-9434-b1c47ef561ad (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a7b530a-ab69-4212-9cbe-12a70e63ecf1 (dataset): DatasetConfig { id: 7a7b530a-ab69-4212-9cbe-12a70e63ecf1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ad00de1-13f5-4b21-9f7d-69855b4e00f7 (dataset): DatasetConfig { id: 7ad00de1-13f5-4b21-9f7d-69855b4e00f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b0d1c4d-5e9e-4914-8b03-d76d46909499 (dataset): DatasetConfig { id: 7b0d1c4d-5e9e-4914-8b03-d76d46909499 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7db41b11-250a-408e-9925-6b1c3f152549 (dataset): DatasetConfig { id: 7db41b11-250a-408e-9925-6b1c3f152549 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e05bce3-e10e-41e3-8ff3-79e6062bb004 (dataset): DatasetConfig { id: 7e05bce3-e10e-41e3-8ff3-79e6062bb004 (dataset), name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f58def9-4481-4e54-85c8-27eecc478afb (dataset): DatasetConfig { id: 7f58def9-4481-4e54-85c8-27eecc478afb (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8012c335-6686-44eb-ad85-40239ae1b5af (dataset): DatasetConfig { id: 8012c335-6686-44eb-ad85-40239ae1b5af (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 806f782f-8e86-487f-b147-2c79c767105a (dataset): DatasetConfig { id: 806f782f-8e86-487f-b147-2c79c767105a (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82578f61-cc0d-4757-88a9-dc16fdbd795e (dataset): DatasetConfig { id: 82578f61-cc0d-4757-88a9-dc16fdbd795e (dataset), name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 854a3b3e-822d-4d2d-8c9c-2f299213817f (dataset): DatasetConfig { id: 854a3b3e-822d-4d2d-8c9c-2f299213817f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 86cd000d-434e-48f1-8422-53f74bef12a9 (dataset): DatasetConfig { id: 86cd000d-434e-48f1-8422-53f74bef12a9 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8ab90a49-d39c-4329-aca7-15bc8fcdab15 (dataset): DatasetConfig { id: 8ab90a49-d39c-4329-aca7-15bc8fcdab15 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dee6759-f358-4822-a25f-7c6f95041b00 (dataset): DatasetConfig { id: 8dee6759-f358-4822-a25f-7c6f95041b00 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9420eeed-ede0-4fd4-8854-abf5cf06d9d6 (dataset): DatasetConfig { id: 9420eeed-ede0-4fd4-8854-abf5cf06d9d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9562f0df-fda3-4526-817c-08c1846d64e6 (dataset): DatasetConfig { id: 9562f0df-fda3-4526-817c-08c1846d64e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa4393c7-7c1c-419b-9bc4-a50f58b87094 (dataset): DatasetConfig { id: aa4393c7-7c1c-419b-9bc4-a50f58b87094 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1fbace0-083e-4a3b-a533-faa585bc9821 (dataset): DatasetConfig { id: b1fbace0-083e-4a3b-a533-faa585bc9821 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3d403d7-5ce7-4309-ae79-97a1a8854865 (dataset): DatasetConfig { id: b3d403d7-5ce7-4309-ae79-97a1a8854865 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bc14e274-ad22-45e6-b484-8f966376dca9 (dataset): DatasetConfig { id: bc14e274-ad22-45e6-b484-8f966376dca9 (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bcb64b3b-921a-4e76-aaf0-e0a853b2d956 (dataset): DatasetConfig { id: bcb64b3b-921a-4e76-aaf0-e0a853b2d956 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, be894ba2-2ba1-4bc3-ac24-cfac8246b0e6 (dataset): DatasetConfig { id: be894ba2-2ba1-4bc3-ac24-cfac8246b0e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7bffcc7-7fbe-42d6-ba8a-55481404ab9e (dataset): DatasetConfig { id: c7bffcc7-7fbe-42d6-ba8a-55481404ab9e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c85f45df-07e1-4930-ab91-5331a45c0147 (dataset): DatasetConfig { id: c85f45df-07e1-4930-ab91-5331a45c0147 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d1dd1157-2c9f-4292-b41b-2b728c7ca700 (dataset): DatasetConfig { id: d1dd1157-2c9f-4292-b41b-2b728c7ca700 (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9fdead0-f3b5-478b-94d6-0c98c36be40b (dataset): DatasetConfig { id: d9fdead0-f3b5-478b-94d6-0c98c36be40b (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, da0e4ebe-488c-47c4-8ee2-656e5b9ee4cf (dataset): DatasetConfig { id: da0e4ebe-488c-47c4-8ee2-656e5b9ee4cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddead89e-0465-4599-b8f8-556dcd3b0bd0 (dataset): DatasetConfig { id: ddead89e-0465-4599-b8f8-556dcd3b0bd0 (dataset), name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de910bb1-cbad-45b8-a0b3-4ecb0e8837d4 (dataset): DatasetConfig { id: de910bb1-cbad-45b8-a0b3-4ecb0e8837d4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e2b03a75-e5a2-4279-9682-115cc246468a (dataset): DatasetConfig { id: e2b03a75-e5a2-4279-9682-115cc246468a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e658f38c-dbdc-4a2b-84a1-9364fa862ae0 (dataset): DatasetConfig { id: e658f38c-dbdc-4a2b-84a1-9364fa862ae0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, eb55dc02-b291-4f13-9c7f-f445eb18b893 (dataset): DatasetConfig { id: eb55dc02-b291-4f13-9c7f-f445eb18b893 (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ef33b084-b829-424f-b683-bad673caa8cc (dataset): DatasetConfig { id: ef33b084-b829-424f-b683-bad673caa8cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efa90dea-53eb-4885-b98d-8ba811a3f49b (dataset): DatasetConfig { id: efa90dea-53eb-4885-b98d-8ba811a3f49b (dataset), name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0e67934-e6e6-42cd-9339-d8e71175cd82 (dataset): DatasetConfig { id: f0e67934-e6e6-42cd-9339-d8e71175cd82 (dataset), name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f24f0ac3-f266-4fee-b6f5-ddf3faf9fe2d (dataset): DatasetConfig { id: f24f0ac3-f266-4fee-b6f5-ddf3faf9fe2d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f61afb7a-2a48-457c-b9d4-7a366790c6fa (dataset): DatasetConfig { id: f61afb7a-2a48-457c-b9d4-7a366790c6fa (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f6356de8-96f5-4a93-a961-cfae31f23e6e (dataset): DatasetConfig { id: f6356de8-96f5-4a93-a961-cfae31f23e6e (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f787225e-6126-4688-8292-b42eae551bab (dataset): DatasetConfig { id: f787225e-6126-4688-8292-b42eae551bab (dataset), name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f7cde5e9-1469-4cee-8b58-50bb4bf31b38 (dataset): DatasetConfig { id: f7cde5e9-1469-4cee-8b58-50bb4bf31b38 (dataset), name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4492025-01-08T15:17:45.989ZINFOSledAgent (StorageManager): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4502025-01-08T15:17:45.989ZINFOSledAgent (StorageManager): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512025-01-08T15:17:45.989ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4522025-01-08T15:17:46.005ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532025-01-08T15:17:46.005ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4542025-01-08T15:17:46.005ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone" } file = sled-storage/src/manager.rs:1431
4552025-01-08T15:17:46.038ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-01-08T15:17:46.038ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4572025-01-08T15:17:46.038ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crucible" } file = sled-storage/src/manager.rs:1431
4582025-01-08T15:17:46.087ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-01-08T15:17:46.087ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602025-01-08T15:17:46.087ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/04d48b1d-c030-493d-84a2-8ba81e39ea46/crypt/zone/oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486"), full_name: "oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46/crypt/zone/oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486" } file = sled-storage/src/manager.rs:1431
4612025-01-08T15:17:46.149ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-08T15:17:46.149ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-01-08T15:17:46.149ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crucible" } file = sled-storage/src/manager.rs:1431
4642025-01-08T15:17:46.198ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-01-08T15:17:46.198ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-01-08T15:17:46.198ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92" } file = sled-storage/src/manager.rs:1431
4672025-01-08T15:17:46.258ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-08T15:17:46.259ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-01-08T15:17:46.259ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5" } file = sled-storage/src/manager.rs:1431
4702025-01-08T15:17:46.320ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-08T15:17:46.320ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4722025-01-08T15:17:46.320ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/debug"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/debug" } file = sled-storage/src/manager.rs:1431
4732025-01-08T15:17:46.350ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-08T15:17:46.350ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4752025-01-08T15:17:46.350ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone" } file = sled-storage/src/manager.rs:1431
4762025-01-08T15:17:46.378ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-08T15:17:46.378ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-01-08T15:17:46.378ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2838adfd-6724-4d11-9727-968f07762cf0/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4792025-01-08T15:17:46.429ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-01-08T15:17:46.429ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4812025-01-08T15:17:46.429ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/04d48b1d-c030-493d-84a2-8ba81e39ea46/crypt/debug"), full_name: "oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46/crypt/debug" } file = sled-storage/src/manager.rs:1431
4822025-01-08T15:17:46.457ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-01-08T15:17:46.457ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4842025-01-08T15:17:46.457ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crucible" } file = sled-storage/src/manager.rs:1431
4852025-01-08T15:17:46.506ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-01-08T15:17:46.506ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872025-01-08T15:17:46.506ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4882025-01-08T15:17:46.555ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-01-08T15:17:46.555ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902025-01-08T15:17:46.555ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3" } file = sled-storage/src/manager.rs:1431
4912025-01-08T15:17:46.614ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-01-08T15:17:46.614ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4932025-01-08T15:17:46.614ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2838adfd-6724-4d11-9727-968f07762cf0/crypt/zone/oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0"), full_name: "oxp_2838adfd-6724-4d11-9727-968f07762cf0/crypt/zone/oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0" } file = sled-storage/src/manager.rs:1431
4942025-01-08T15:17:46.636ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 23.13779328s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
4952025-01-08T15:17:46.673ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-01-08T15:17:46.673ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4972025-01-08T15:17:46.673ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc669d0-0094-4137-bc22-36487a33d705/crypt/debug"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/debug" } file = sled-storage/src/manager.rs:1431
4982025-01-08T15:17:46.703ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-01-08T15:17:46.703ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002025-01-08T15:17:46.703ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0" } file = sled-storage/src/manager.rs:1431
5012025-01-08T15:17:46.763ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-01-08T15:17:46.763ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-01-08T15:17:46.763ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5042025-01-08T15:17:46.812ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-01-08T15:17:46.812ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5062025-01-08T15:17:46.812ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2838adfd-6724-4d11-9727-968f07762cf0/crucible" } file = sled-storage/src/manager.rs:1431
5072025-01-08T15:17:46.860ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-01-08T15:17:46.860ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5092025-01-08T15:17:46.860ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crucible" } file = sled-storage/src/manager.rs:1431
5102025-01-08T15:17:46.911ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-01-08T15:17:46.911ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122025-01-08T15:17:46.911ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8" } file = sled-storage/src/manager.rs:1431
5132025-01-08T15:17:46.928ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14) file = sled-agent/src/probe_manager.rs:231 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
5142025-01-08T15:17:46.972ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152025-01-08T15:17:46.972ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5162025-01-08T15:17:46.972ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crypt/debug"), full_name: "oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crypt/debug" } file = sled-storage/src/manager.rs:1431
5172025-01-08T15:17:47.001ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182025-01-08T15:17:47.001ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5192025-01-08T15:17:47.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/zone"), full_name: "oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/zone" } file = sled-storage/src/manager.rs:1431
5202025-01-08T15:17:47.032ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212025-01-08T15:17:47.032ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5222025-01-08T15:17:47.032ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5232025-01-08T15:17:47.083ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242025-01-08T15:17:47.083ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252025-01-08T15:17:47.083ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/zone/oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43"), full_name: "oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/zone/oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43" } file = sled-storage/src/manager.rs:1431
5262025-01-08T15:17:47.143ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272025-01-08T15:17:47.143ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5282025-01-08T15:17:47.143ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5292025-01-08T15:17:47.194ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302025-01-08T15:17:47.194ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312025-01-08T15:17:47.194ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crucible" } file = sled-storage/src/manager.rs:1431
5322025-01-08T15:17:47.244ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-01-08T15:17:47.244ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342025-01-08T15:17:47.244ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7" } file = sled-storage/src/manager.rs:1431
5352025-01-08T15:17:47.304ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-01-08T15:17:47.304ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372025-01-08T15:17:47.304ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46/crucible" } file = sled-storage/src/manager.rs:1431
5382025-01-08T15:17:47.352ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-01-08T15:17:47.352ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402025-01-08T15:17:47.352ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2838adfd-6724-4d11-9727-968f07762cf0/crypt/zone/oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9"), full_name: "oxp_2838adfd-6724-4d11-9727-968f07762cf0/crypt/zone/oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9" } file = sled-storage/src/manager.rs:1431
5412025-01-08T15:17:47.412ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422025-01-08T15:17:47.412ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5432025-01-08T15:17:47.412ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/debug"), full_name: "oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/debug" } file = sled-storage/src/manager.rs:1431
5442025-01-08T15:17:47.441ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-01-08T15:17:47.441ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462025-01-08T15:17:47.441ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6" } file = sled-storage/src/manager.rs:1431
5472025-01-08T15:17:47.502ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-01-08T15:17:47.502ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5492025-01-08T15:17:47.502ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/04d48b1d-c030-493d-84a2-8ba81e39ea46/crypt/zone"), full_name: "oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46/crypt/zone" } file = sled-storage/src/manager.rs:1431
5502025-01-08T15:17:47.532ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-01-08T15:17:47.532ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522025-01-08T15:17:47.532ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/zone/oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d"), full_name: "oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/zone/oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d" } file = sled-storage/src/manager.rs:1431
5532025-01-08T15:17:47.594ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-08T15:17:47.594ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5552025-01-08T15:17:47.594ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2838adfd-6724-4d11-9727-968f07762cf0/crypt/zone/oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f"), full_name: "oxp_2838adfd-6724-4d11-9727-968f07762cf0/crypt/zone/oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f" } file = sled-storage/src/manager.rs:1431
5562025-01-08T15:17:47.655ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-08T15:17:47.655ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5582025-01-08T15:17:47.655ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/zone"), full_name: "oxp_f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/zone" } file = sled-storage/src/manager.rs:1431
5592025-01-08T15:17:47.685ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-01-08T15:17:47.685ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5612025-01-08T15:17:47.685ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crucible" } file = sled-storage/src/manager.rs:1431
5622025-01-08T15:17:47.734ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-01-08T15:17:47.734ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5642025-01-08T15:17:47.734ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2838adfd-6724-4d11-9727-968f07762cf0/crypt/debug"), full_name: "oxp_2838adfd-6724-4d11-9727-968f07762cf0/crypt/debug" } file = sled-storage/src/manager.rs:1431
5652025-01-08T15:17:47.763ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5662025-01-08T15:17:47.763ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5672025-01-08T15:17:47.763ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d" } file = sled-storage/src/manager.rs:1431
5682025-01-08T15:17:47.825ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5692025-01-08T15:17:47.825ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5702025-01-08T15:17:47.825ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4" } file = sled-storage/src/manager.rs:1431
5712025-01-08T15:17:47.884ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5722025-01-08T15:17:47.884ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5732025-01-08T15:17:47.884ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/zone/oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2"), full_name: "oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/zone/oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2" } file = sled-storage/src/manager.rs:1431
5742025-01-08T15:17:47.930ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14) file = sled-agent/src/probe_manager.rs:231 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
5752025-01-08T15:17:47.945ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762025-01-08T15:17:47.945ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5772025-01-08T15:17:47.945ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2838adfd-6724-4d11-9727-968f07762cf0/crypt/zone"), full_name: "oxp_2838adfd-6724-4d11-9727-968f07762cf0/crypt/zone" } file = sled-storage/src/manager.rs:1431
5782025-01-08T15:17:47.974ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-01-08T15:17:47.974ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802025-01-08T15:17:47.974ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/zone/oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674"), full_name: "oxp_f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/zone/oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674" } file = sled-storage/src/manager.rs:1431
5812025-01-08T15:17:48.035ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822025-01-08T15:17:48.035ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832025-01-08T15:17:48.035ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0" } file = sled-storage/src/manager.rs:1431
5842025-01-08T15:17:48.095ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852025-01-08T15:17:48.095ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862025-01-08T15:17:48.095ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a" } file = sled-storage/src/manager.rs:1431
5872025-01-08T15:17:48.155ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882025-01-08T15:17:48.155ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5892025-01-08T15:17:48.155ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crypt/zone"), full_name: "oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crypt/zone" } file = sled-storage/src/manager.rs:1431
5902025-01-08T15:17:48.186ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912025-01-08T15:17:48.186ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5922025-01-08T15:17:48.186ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/debug"), full_name: "oxp_f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/debug" } file = sled-storage/src/manager.rs:1431
5932025-01-08T15:17:48.215ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-01-08T15:17:48.215ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5952025-01-08T15:17:48.215ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5962025-01-08T15:17:48.265ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-01-08T15:17:48.265ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5982025-01-08T15:17:48.265ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c" } file = sled-storage/src/manager.rs:1431
5992025-01-08T15:17:48.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002025-01-08T15:17:48.325ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6012025-01-08T15:17:48.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60" } file = sled-storage/src/manager.rs:1431
6022025-01-08T15:17:48.387ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032025-01-08T15:17:48.387ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6042025-01-08T15:17:48.387ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/zone/oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304"), full_name: "oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/zone/oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304" } file = sled-storage/src/manager.rs:1431
6052025-01-08T15:17:48.449ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062025-01-08T15:17:48.449ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6072025-01-08T15:17:48.449ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone/oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee" } file = sled-storage/src/manager.rs:1431
6082025-01-08T15:17:48.510ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092025-01-08T15:17:48.510ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102025-01-08T15:17:48.510ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6112025-01-08T15:17:48.561ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122025-01-08T15:17:48.561ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6132025-01-08T15:17:48.561ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/debug"), full_name: "oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/debug" } file = sled-storage/src/manager.rs:1431
6142025-01-08T15:17:48.591ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6152025-01-08T15:17:48.591ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6162025-01-08T15:17:48.591ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/zone"), full_name: "oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/zone" } file = sled-storage/src/manager.rs:1431
6172025-01-08T15:17:48.620ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6182025-01-08T15:17:48.620ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6192025-01-08T15:17:48.620ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/zone/oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486"), full_name: "oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/zone/oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486" } file = sled-storage/src/manager.rs:1431
6202025-01-08T15:17:48.681ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6212025-01-08T15:17:48.681ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6222025-01-08T15:17:48.681ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6232025-01-08T15:17:48.732ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6242025-01-08T15:17:48.732ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6252025-01-08T15:17:48.732ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6262025-01-08T15:17:48.784ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6272025-01-08T15:17:48.784ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6282025-01-08T15:17:48.784ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/debug"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/debug" } file = sled-storage/src/manager.rs:1431
6292025-01-08T15:17:48.813ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6302025-01-08T15:17:48.814ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6312025-01-08T15:17:48.814ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6322025-01-08T15:17:48.865ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6332025-01-08T15:17:48.865ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6342025-01-08T15:17:48.865ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456"), full_name: "oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/zone/oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456" } file = sled-storage/src/manager.rs:1431
6352025-01-08T15:17:48.926ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6362025-01-08T15:17:48.927ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6372025-01-08T15:17:48.927ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crypt/zone/oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032"), full_name: "oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crypt/zone/oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032" } file = sled-storage/src/manager.rs:1431
6382025-01-08T15:17:48.933ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14) file = sled-agent/src/probe_manager.rs:231 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
6392025-01-08T15:17:48.988ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402025-01-08T15:17:48.988ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412025-01-08T15:17:48.988ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d"), full_name: "oxp_2bc669d0-0094-4137-bc22-36487a33d705/crypt/zone/oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d" } file = sled-storage/src/manager.rs:1431
6422025-01-08T15:17:49.049ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432025-01-08T15:17:49.049ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442025-01-08T15:17:49.049ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_f80f84fb-0d35-46c9-a329-b7397a036f55/crucible" } file = sled-storage/src/manager.rs:1431
6452025-01-08T15:17:49.100ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462025-01-08T15:17:49.100ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6472025-01-08T15:17:49.100ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/zone" } file = sled-storage/src/manager.rs:1431
6482025-01-08T15:17:49.130ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6492025-01-08T15:17:49.130ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6502025-01-08T15:17:49.130ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6512025-01-08T15:17:49.181ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6522025-01-08T15:17:49.181ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6532025-01-08T15:17:49.181ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/zone/oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3"), full_name: "oxp_f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/zone/oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3" } file = sled-storage/src/manager.rs:1431
6542025-01-08T15:17:49.245ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6552025-01-08T15:17:49.245ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6562025-01-08T15:17:49.246ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
6572025-01-08T15:17:49.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3257929 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33032 req_id = 257785e7-e285-4e6c-81d9-25b40207be38 response_code = 200 uri = /datasets
6582025-01-08T15:17:49.278ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: c83545e9-4211-4dca-9ec0-0f110abfca92 (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ea871c24-fe68-43ce-af24-67c6f74ea37d (service), filesystem_pool: Some(ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: bd3e994a-ca27-4475-b826-d1843113ddee (service), filesystem_pool: Some(ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6592025-01-08T15:17:49.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43770
6602025-01-08T15:17:49.278ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-01-08T15:17:49.278ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-01-08T15:17:49.288ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6632025-01-08T15:17:49.288ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6642025-01-08T15:17:49.297ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6652025-01-08T15:17:49.297ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6662025-01-08T15:17:49.305ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-08T15:17:49.305ZINFOSledAgent (ServiceManager): No ledger in /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:188
6682025-01-08T15:17:49.305ZINFOSledAgent (ServiceManager): No ledger in /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:188
6692025-01-08T15:17:49.305ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6702025-01-08T15:17:49.351ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-01-08T15:17:49.351ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-01-08T15:17:49.351ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6732025-01-08T15:17:49.403ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92 file = illumos-utils/src/zone.rs:325
6742025-01-08T15:17:49.407ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d file = illumos-utils/src/zone.rs:325
6752025-01-08T15:17:49.411ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee file = illumos-utils/src/zone.rs:325
6762025-01-08T15:17:49.423ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92 file = illumos-utils/src/zone.rs:363
6772025-01-08T15:17:49.427ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d file = illumos-utils/src/zone.rs:363
6782025-01-08T15:17:49.431ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee file = illumos-utils/src/zone.rs:363
6792025-01-08T15:17:49.935ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/ba54f0e2-bde0-4da7-a58e-566dc5903c14) file = sled-agent/src/probe_manager.rs:231 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
6802025-01-08T15:17:51.014ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6812025-01-08T15:17:51.014ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6822025-01-08T15:17:51.285ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4467
6832025-01-08T15:17:51.285ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4494
6842025-01-08T15:17:51.323ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4507
6852025-01-08T15:17:51.323ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4353
6862025-01-08T15:17:51.373ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4395
6872025-01-08T15:17:51.373ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4474 rack_subnet = fd00:1122:3344::
6882025-01-08T15:17:51.394ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4485
6892025-01-08T15:17:51.394ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4527
6902025-01-08T15:17:51.461ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4559
6912025-01-08T15:17:51.461ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4565
6922025-01-08T15:17:51.496ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6932025-01-08T15:17:51.496ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
6942025-01-08T15:17:51.501ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6952025-01-08T15:17:51.557ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4606
6962025-01-08T15:17:51.557ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6972025-01-08T15:17:51.696ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 145608393471572222 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
6982025-01-08T15:17:51.696ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10415190375264559790 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
6992025-01-08T15:17:51.730ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 73.900108ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
7002025-01-08T15:17:51.806ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 134.128052ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
7012025-01-08T15:17:51.941ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7022025-01-08T15:17:51.980ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7032025-01-08T15:17:51.980ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7042025-01-08T15:17:51.981ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 0
7052025-01-08T15:17:51.981ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7062025-01-08T15:17:51.983ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7072025-01-08T15:17:51.984ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7082025-01-08T15:17:52.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee") failed: Property not found. retry in 67.109753ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
7092025-01-08T15:17:52.000ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
7102025-01-08T15:17:52.000ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7112025-01-08T15:17:52.031ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
7122025-01-08T15:17:52.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee") failed: Property not found. retry in 116.338448ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
7132025-01-08T15:17:52.091ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7142025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7152025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7162025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7172025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7182025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7192025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7202025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7212025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7222025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7232025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7242025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7252025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7262025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7272025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7282025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7292025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7302025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7312025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7322025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7332025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7342025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7352025-01-08T15:17:52.091ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7362025-01-08T15:17:52.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d") failed: Property not found. retry in 44.974789ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7372025-01-08T15:17:52.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 34.994029ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7382025-01-08T15:17:52.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d") failed: Property not found. retry in 145.08511ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7392025-01-08T15:17:52.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 126.826238ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7402025-01-08T15:17:52.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee") failed: Property not found. retry in 170.548797ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
7412025-01-08T15:17:52.469ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 215.803366ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7422025-01-08T15:17:52.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d") failed: Property not found. retry in 225.138309ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7432025-01-08T15:17:52.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee") failed: Property not found. retry in 381.338296ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
7442025-01-08T15:17:52.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 302.768455ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7452025-01-08T15:17:52.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d") failed: Property not found. retry in 276.325927ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7462025-01-08T15:17:52.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee") failed: Property not found. retry in 862.677282ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
7472025-01-08T15:17:52.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4213946498897678202 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
7482025-01-08T15:17:52.904ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5916213442440478333 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
7492025-01-08T15:17:53.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 618.543484ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7502025-01-08T15:17:53.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d") failed: Property not found. retry in 866.985718ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7512025-01-08T15:17:53.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 841.275143ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7522025-01-08T15:17:53.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee") failed: Property not found. retry in 1.208180836s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
7532025-01-08T15:17:53.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d") failed: Property not found. retry in 828.179323ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7542025-01-08T15:17:54.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 544.303575ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7552025-01-08T15:17:54.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d") failed: Property not found. retry in 1.115310572s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7562025-01-08T15:17:54.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee") failed: Property not found. retry in 1.143233247s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
7572025-01-08T15:17:55.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 1.038644688s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7582025-01-08T15:17:55.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d") failed: Property not found. retry in 776.263987ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7592025-01-08T15:17:56.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 1.079076594s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7602025-01-08T15:17:56.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee") failed: Property not found. retry in 1.422630356s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
7612025-01-08T15:17:56.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d") failed: Property not found. retry in 932.422437ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7622025-01-08T15:17:57.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92") failed: Property not found. retry in 779.030406ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7632025-01-08T15:17:57.978ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_c83545e9-4211-4dca-9ec0-0f110abfca92
7642025-01-08T15:17:57.978ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_ea871c24-fe68-43ce-af24-67c6f74ea37d
7652025-01-08T15:17:57.978ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_bd3e994a-ca27-4475-b826-d1843113ddee
7662025-01-08T15:17:57.978ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7672025-01-08T15:17:57.978ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7682025-01-08T15:17:57.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8700482 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43770 req_id = bc645773-9b6b-4039-890d-9adc85f83e5c response_code = 204 uri = /omicron-zones
7692025-01-08T15:17:57.981ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702025-01-08T15:17:58.176ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 128.969007ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7712025-01-08T15:17:58.323ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7722025-01-08T15:17:58.371ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7732025-01-08T15:17:58.418ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7742025-01-08T15:17:58.418ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7752025-01-08T15:17:58.450ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7762025-01-08T15:17:58.451ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7772025-01-08T15:17:58.451ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7782025-01-08T15:17:58.481ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: c83545e9-4211-4dca-9ec0-0f110abfca92 (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ea871c24-fe68-43ce-af24-67c6f74ea37d (service), filesystem_pool: Some(ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: bd3e994a-ca27-4475-b826-d1843113ddee (service), filesystem_pool: Some(ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: fc82a29b-8b06-4b52-a244-265ce127d51d (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2fcf31ef-f2bb-46da-9d86-d94cad77ac17, kind: Service { id: fc82a29b-8b06-4b52-a244-265ce127d51d }, name: Name("ntp-fc82a29b-8b06-4b52-a244-265ce127d51d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 159])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7792025-01-08T15:17:58.481ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48632
7802025-01-08T15:17:58.481ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-01-08T15:17:58.481ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-01-08T15:17:58.493ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7832025-01-08T15:17:58.493ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7842025-01-08T15:17:58.502ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7852025-01-08T15:17:58.502ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7862025-01-08T15:17:58.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872025-01-08T15:17:58.511ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:177
7882025-01-08T15:17:58.511ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:177
7892025-01-08T15:17:58.511ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7902025-01-08T15:17:58.523ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7912025-01-08T15:17:58.555ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7922025-01-08T15:17:58.556ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7932025-01-08T15:17:58.556ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7942025-01-08T15:17:58.586ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 229, 159]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7952025-01-08T15:17:58.586ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = boundary_ntp
7962025-01-08T15:17:58.586ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7972025-01-08T15:17:58.586ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7982025-01-08T15:17:58.586ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7992025-01-08T15:17:58.587ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8002025-01-08T15:17:58.611ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d file = illumos-utils/src/zone.rs:325
8012025-01-08T15:17:58.629ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d file = illumos-utils/src/zone.rs:363
8022025-01-08T15:17:59.235ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8032025-01-08T15:17:59.235ZINFOSledAgent (ServiceManager): Booting oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8042025-01-08T15:17:59.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 29.05419ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8052025-01-08T15:17:59.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 78.428327ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8062025-01-08T15:17:59.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 230.693103ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8072025-01-08T15:17:59.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 282.154274ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8082025-01-08T15:18:00.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 443.998861ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8092025-01-08T15:18:00.474ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 772.667949ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8102025-01-08T15:18:01.256ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 500.304656ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8112025-01-08T15:18:01.697ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 145608393471572222 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8122025-01-08T15:18:01.697ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10415190375264559790 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8132025-01-08T15:18:01.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 892.770377ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8142025-01-08T15:18:02.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 1.115049124s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8152025-01-08T15:18:02.906ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4213946498897678202 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8162025-01-08T15:18:02.906ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5916213442440478333 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8172025-01-08T15:18:03.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d") failed: Property not found. retry in 1.212927618s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8182025-01-08T15:18:05.024ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d
8192025-01-08T15:18:05.024ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8202025-01-08T15:18:05.024ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8212025-01-08T15:18:05.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6543693 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:48632 req_id = d0f7c51e-41b5-49c8-9e09-8763d24da80a response_code = 204 uri = /omicron-zones
8222025-01-08T15:18:05.027ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8232025-01-08T15:18:05.057ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8242025-01-08T15:18:05.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57257
8252025-01-08T15:18:05.066ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8262025-01-08T15:18:05.066ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8396 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57257 req_id = 6497b856-7088-46f0-939e-49eebd7c8b92 response_code = 500 uri = /timesync
8272025-01-08T15:18:05.069ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8282025-01-08T15:18:05.201ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8292025-01-08T15:18:05.202ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62281
8302025-01-08T15:18:07.600ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4687632464475460286 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8312025-01-08T15:18:07.606ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9847465182380664474 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8322025-01-08T15:18:07.981ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17614777913018919720 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8332025-01-08T15:18:09.211ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8342025-01-08T15:18:09.211ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009059 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62281 req_id = c724efe9-be61-4e18-b4b0-ef9550d45f05 response_code = 500 uri = /timesync
8352025-01-08T15:18:09.214ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362025-01-08T15:18:09.370ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8372025-01-08T15:18:09.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34603
8382025-01-08T15:18:09.379ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8392025-01-08T15:18:09.379ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8394 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34603 req_id = e50ffb70-7365-4db2-8082-423180789268 response_code = 500 uri = /timesync
8402025-01-08T15:18:09.381ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8412025-01-08T15:18:09.489ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8422025-01-08T15:18:09.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47757
8432025-01-08T15:18:11.698ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 145608393471572222 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8442025-01-08T15:18:11.698ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10415190375264559790 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8452025-01-08T15:18:13.005ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4213946498897678202 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8462025-01-08T15:18:13.006ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5916213442440478333 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8472025-01-08T15:18:13.596ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_fc82a29b-8b06-4b52-a244-265ce127d51d': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8482025-01-08T15:18:13.597ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009089 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47757 req_id = 5893a54b-91da-4d83-88ac-7afc442855fd response_code = 500 uri = /timesync
8492025-01-08T15:18:13.599ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8502025-01-08T15:18:13.801ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8512025-01-08T15:18:13.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38781
8522025-01-08T15:18:13.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8708 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38781 req_id = 2b663626-07d5-4b23-82ae-73b603d742b3 response_code = 200 uri = /timesync
8532025-01-08T15:18:13.814ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.074542671 } file = sled-agent/src/rack_setup/service.rs:743
8542025-01-08T15:18:13.814ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8552025-01-08T15:18:13.971ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8562025-01-08T15:18:13.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40200
8572025-01-08T15:18:13.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40200 req_id = 278bf9dd-a913-47e6-a607-0316de371f9c response_code = 200 uri = /timesync
8582025-01-08T15:18:13.983ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.074086554 } file = sled-agent/src/rack_setup/service.rs:743
8592025-01-08T15:18:13.983ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8602025-01-08T15:18:14.386ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8612025-01-08T15:18:14.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55978
8622025-01-08T15:18:14.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8833 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55978 req_id = 284502b3-338c-4057-ba4a-dda9ea4b8921 response_code = 200 uri = /timesync
8632025-01-08T15:18:14.398ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1736349494.2966864, correction: 0.072676465 } file = sled-agent/src/rack_setup/service.rs:743
8642025-01-08T15:18:14.398ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8652025-01-08T15:18:14.627ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8662025-01-08T15:18:14.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43709
8672025-01-08T15:18:14.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43709 req_id = 7f550bc7-65d6-45b5-a994-63a238172712 response_code = 200 uri = /timesync
8682025-01-08T15:18:14.638ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736349493.4955866, correction: 0.072026238 } file = sled-agent/src/rack_setup/service.rs:743
8692025-01-08T15:18:14.638ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8702025-01-08T15:18:14.967ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8712025-01-08T15:18:14.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46645
8722025-01-08T15:18:14.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46645 req_id = 779c8e51-ece8-42df-af7d-ad37a3f34cc3 response_code = 200 uri = /timesync
8732025-01-08T15:18:14.978ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736349493.4955866, correction: 0.071108542 } file = sled-agent/src/rack_setup/service.rs:743
8742025-01-08T15:18:14.978ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8752025-01-08T15:18:15.131ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12665557070005609237 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8762025-01-08T15:18:15.131ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11788271321592646126 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8772025-01-08T15:18:15.259ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8782025-01-08T15:18:15.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38034
8792025-01-08T15:18:15.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7803 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38034 req_id = 3a22c5de-c8f6-4d53-bf03-f0ecb7f12af6 response_code = 200 uri = /timesync
8802025-01-08T15:18:15.271ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736349493.4955866, correction: 0.070319735 } file = sled-agent/src/rack_setup/service.rs:743
8812025-01-08T15:18:15.271ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8822025-01-08T15:18:15.956ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8832025-01-08T15:18:15.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39601
8842025-01-08T15:18:15.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8006 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39601 req_id = 6ef5c30d-a946-4ecb-a5bf-9e6e90fe2b5d response_code = 200 uri = /timesync
8852025-01-08T15:18:15.967ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1736349494.7721388, correction: 0.067892842 } file = sled-agent/src/rack_setup/service.rs:743
8862025-01-08T15:18:15.967ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8872025-01-08T15:18:16.592ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8882025-01-08T15:18:16.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48275
8892025-01-08T15:18:16.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8950 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48275 req_id = 7a56e640-9662-4fc1-aac3-1ac282b3e9a6 response_code = 200 uri = /timesync
8902025-01-08T15:18:16.605ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1736349495.544969, correction: 0.061263464 } file = sled-agent/src/rack_setup/service.rs:743
8912025-01-08T15:18:16.605ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8922025-01-08T15:18:17.314ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8932025-01-08T15:18:17.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58398
8942025-01-08T15:18:17.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8381 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58398 req_id = 4dd7ea24-f48c-4cfc-a907-e34ea92531d4 response_code = 200 uri = /timesync
8952025-01-08T15:18:17.326ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1736349495.544969, correction: 0.059312835 } file = sled-agent/src/rack_setup/service.rs:743
8962025-01-08T15:18:17.326ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8972025-01-08T15:18:17.713ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4687632464475460286 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8982025-01-08T15:18:17.718ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9847465182380664474 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
8992025-01-08T15:18:18.095ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17614777913018919720 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
9002025-01-08T15:18:18.543ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9012025-01-08T15:18:18.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60020
9022025-01-08T15:18:18.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9069 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60020 req_id = c9ab6123-21ae-43ce-bf09-fe0238e23f3d response_code = 200 uri = /timesync
9032025-01-08T15:18:18.555ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1736349497.8270674, correction: 0.055021323 } file = sled-agent/src/rack_setup/service.rs:743
9042025-01-08T15:18:18.555ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9052025-01-08T15:18:19.805ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9062025-01-08T15:18:19.806ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34542
9072025-01-08T15:18:19.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8845 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34542 req_id = 18a6d9ac-88ff-4b73-a02f-537b980a7fbd response_code = 200 uri = /timesync
9082025-01-08T15:18:19.818ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1736349498.614931, correction: 0.051791713 } file = sled-agent/src/rack_setup/service.rs:743
9092025-01-08T15:18:19.818ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9102025-01-08T15:18:21.297ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9112025-01-08T15:18:21.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43405
9122025-01-08T15:18:21.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21474 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43405 req_id = d9323328-6ed5-4674-b3e0-8a44696f0f1a response_code = 200 uri = /timesync
9132025-01-08T15:18:21.323ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 861000168, ip_addr: 51.81.209.232, stratum: 3, ref_time: 1736349499.5917163, correction: 0.047277417 } file = sled-agent/src/rack_setup/service.rs:743
9142025-01-08T15:18:21.323ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9152025-01-08T15:18:21.352ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: c83545e9-4211-4dca-9ec0-0f110abfca92 (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ea871c24-fe68-43ce-af24-67c6f74ea37d (service), filesystem_pool: Some(ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: bd3e994a-ca27-4475-b826-d1843113ddee (service), filesystem_pool: Some(ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: fc82a29b-8b06-4b52-a244-265ce127d51d (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2fcf31ef-f2bb-46da-9d86-d94cad77ac17, kind: Service { id: fc82a29b-8b06-4b52-a244-265ce127d51d }, name: Name("ntp-fc82a29b-8b06-4b52-a244-265ce127d51d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 159])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: bc093a85-7eac-45fd-88b5-85a8e05d15e7 (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } } } }, OmicronZoneConfig { id: 47ac6b17-3751-48c3-a4cf-463f53a56ba4 (service), filesystem_pool: Some(ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External } } } }, OmicronZoneConfig { id: 245e5f95-a031-4715-b999-dae6bd50878c (service), filesystem_pool: Some(ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: e42d62c1-ed16-4a81-9487-3eccfcc68fb0 (service), filesystem_pool: Some(ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ae0abc8-2930-4671-9558-3abb8a50b674 (service), filesystem_pool: Some(ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9162025-01-08T15:18:21.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40632
9172025-01-08T15:18:21.353ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9182025-01-08T15:18:21.353ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9192025-01-08T15:18:21.363ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9202025-01-08T15:18:21.363ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9212025-01-08T15:18:21.372ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9222025-01-08T15:18:21.372ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9232025-01-08T15:18:21.381ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9242025-01-08T15:18:21.381ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9252025-01-08T15:18:21.392ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9262025-01-08T15:18:21.392ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9272025-01-08T15:18:21.401ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9282025-01-08T15:18:21.401ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9292025-01-08T15:18:21.410ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9302025-01-08T15:18:21.410ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9312025-01-08T15:18:21.418ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9322025-01-08T15:18:21.418ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9332025-01-08T15:18:21.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9342025-01-08T15:18:21.428ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:177
9352025-01-08T15:18:21.428ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:177
9362025-01-08T15:18:21.428ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9372025-01-08T15:18:21.513ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9382025-01-08T15:18:21.513ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9392025-01-08T15:18:21.513ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9402025-01-08T15:18:21.513ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9412025-01-08T15:18:21.513ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9422025-01-08T15:18:21.605ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4 file = illumos-utils/src/zone.rs:325
9432025-01-08T15:18:21.609ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0 file = illumos-utils/src/zone.rs:325
9442025-01-08T15:18:21.613ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674 file = illumos-utils/src/zone.rs:325
9452025-01-08T15:18:21.617ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c file = illumos-utils/src/zone.rs:325
9462025-01-08T15:18:21.622ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7 file = illumos-utils/src/zone.rs:325
9472025-01-08T15:18:21.627ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4 file = illumos-utils/src/zone.rs:363
9482025-01-08T15:18:21.632ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0 file = illumos-utils/src/zone.rs:363
9492025-01-08T15:18:21.636ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674 file = illumos-utils/src/zone.rs:363
9502025-01-08T15:18:21.641ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c file = illumos-utils/src/zone.rs:363
9512025-01-08T15:18:21.645ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7 file = illumos-utils/src/zone.rs:363
9522025-01-08T15:18:22.151ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57622
9532025-01-08T15:18:22.151ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57622 req_id = cce30297-b96f-4e82-99a6-3ff6ff29f729 response_code = 200 uri = /baseboard
9542025-01-08T15:18:24.942ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 273.156612ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
9552025-01-08T15:18:25.554ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5ae0abc8-2930-4671-9558-3abb8a50b674'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9562025-01-08T15:18:25.554ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
9572025-01-08T15:18:25.563ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='bc093a85-7eac-45fd-88b5-85a8e05d15e7'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9582025-01-08T15:18:25.563ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
9592025-01-08T15:18:25.596ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='47ac6b17-3751-48c3-a4cf-463f53a56ba4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9602025-01-08T15:18:25.596ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
9612025-01-08T15:18:25.703ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e42d62c1-ed16-4a81-9487-3eccfcc68fb0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9622025-01-08T15:18:25.704ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
9632025-01-08T15:18:25.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 60.101617ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
9642025-01-08T15:18:25.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 47.685052ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
9652025-01-08T15:18:25.726ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='245e5f95-a031-4715-b999-dae6bd50878c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9662025-01-08T15:18:25.727ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
9672025-01-08T15:18:25.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 63.399259ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
9682025-01-08T15:18:25.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 118.905311ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
9692025-01-08T15:18:25.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 145.681121ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
9702025-01-08T15:18:25.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 114.747142ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
9712025-01-08T15:18:25.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 25.427875ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
9722025-01-08T15:18:25.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 73.991083ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
9732025-01-08T15:18:25.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 174.503761ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
9742025-01-08T15:18:25.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 105.828631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
9752025-01-08T15:18:25.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 246.483866ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
9762025-01-08T15:18:26.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 236.841014ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
9772025-01-08T15:18:26.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 140.383754ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
9782025-01-08T15:18:26.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 143.919281ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
9792025-01-08T15:18:26.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 493.020629ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
9802025-01-08T15:18:26.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 143.760567ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
9812025-01-08T15:18:26.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 217.661859ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
9822025-01-08T15:18:26.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 472.367875ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
9832025-01-08T15:18:26.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 352.44943ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
9842025-01-08T15:18:26.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 540.911403ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
9852025-01-08T15:18:26.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 646.351252ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
9862025-01-08T15:18:26.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 1.052918107s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
9872025-01-08T15:18:26.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 535.556797ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
9882025-01-08T15:18:26.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 836.499856ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
9892025-01-08T15:18:26.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 551.102916ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
9902025-01-08T15:18:27.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 1.190515352s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
9912025-01-08T15:18:27.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 595.142711ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
9922025-01-08T15:18:27.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 1.066906805s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
9932025-01-08T15:18:27.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 514.059711ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
9942025-01-08T15:18:27.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 762.286834ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
9952025-01-08T15:18:27.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 707.59492ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
9962025-01-08T15:18:28.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 1.321236499s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
9972025-01-08T15:18:28.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 1.037493709s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
9982025-01-08T15:18:28.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 1.084354218s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
9992025-01-08T15:18:28.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 1.436092515s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10002025-01-08T15:18:28.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 1.298163668s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10012025-01-08T15:18:29.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 507.583525ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10022025-01-08T15:18:29.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 961.422025ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10032025-01-08T15:18:29.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 1.067121353s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10042025-01-08T15:18:29.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 866.240397ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10052025-01-08T15:18:29.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 507.094695ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10062025-01-08T15:18:29.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 704.075652ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10072025-01-08T15:18:30.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 1.24568606s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10082025-01-08T15:18:30.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 1.45819663s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10092025-01-08T15:18:30.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 768.63642ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10102025-01-08T15:18:30.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 1.021230282s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10112025-01-08T15:18:30.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 832.577523ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10122025-01-08T15:18:31.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 757.204007ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10132025-01-08T15:18:31.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 1.061872551s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10142025-01-08T15:18:31.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 1.475091914s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10152025-01-08T15:18:31.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 1.496628449s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10162025-01-08T15:18:31.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 1.395815066s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10172025-01-08T15:18:32.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 519.901891ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10182025-01-08T15:18:32.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 1.184198378s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10192025-01-08T15:18:32.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 976.12173ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10202025-01-08T15:18:33.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 1.24237278s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10212025-01-08T15:18:33.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 1.183335154s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10222025-01-08T15:18:33.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 1.497019048s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10232025-01-08T15:18:33.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 878.724477ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10242025-01-08T15:18:33.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 586.63117ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10252025-01-08T15:18:34.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 1.25005857s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10262025-01-08T15:18:34.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 1.032276835s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10272025-01-08T15:18:34.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 558.651701ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10282025-01-08T15:18:34.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 1.063750967s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10292025-01-08T15:18:34.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 1.246393519s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10302025-01-08T15:18:35.009ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 949.605ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10312025-01-08T15:18:35.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 596.010547ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10322025-01-08T15:18:35.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 918.24445ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10332025-01-08T15:18:35.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 695.117592ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10342025-01-08T15:18:35.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 1.058496167s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10352025-01-08T15:18:36.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 563.924776ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10362025-01-08T15:18:36.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 543.807633ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10372025-01-08T15:18:36.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 1.48762863s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10382025-01-08T15:18:36.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 1.476450446s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10392025-01-08T15:18:36.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 942.051381ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10402025-01-08T15:18:36.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 1.065852968s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10412025-01-08T15:18:37.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 1.064676278s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10422025-01-08T15:18:37.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 1.099302305s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10432025-01-08T15:18:37.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 1.264087788s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10442025-01-08T15:18:37.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 1.204542111s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10452025-01-08T15:18:38.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 896.867045ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10462025-01-08T15:18:38.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 625.967452ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10472025-01-08T15:18:38.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 532.876019ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10482025-01-08T15:18:38.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 897.710866ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10492025-01-08T15:18:38.988ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 1.009059792s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10502025-01-08T15:18:38.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 1.362612022s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10512025-01-08T15:18:39.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 980.357716ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10522025-01-08T15:18:39.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 1.33588674s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10532025-01-08T15:18:39.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 1.063216083s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10542025-01-08T15:18:40.006ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 718.1367ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10552025-01-08T15:18:40.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 522.902792ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10562025-01-08T15:18:40.291ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 402.164173ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
10572025-01-08T15:18:40.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 719.979407ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10582025-01-08T15:18:40.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 1.042387683s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10592025-01-08T15:18:40.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4") failed: Property not found. retry in 1.109025571s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10602025-01-08T15:18:40.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0") failed: Property not found. retry in 941.059518ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10612025-01-08T15:18:40.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 584.773752ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10622025-01-08T15:18:41.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674") failed: Property not found. retry in 579.637016ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10632025-01-08T15:18:41.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c") failed: Property not found. retry in 1.1220603s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10642025-01-08T15:18:41.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7") failed: Property not found. retry in 1.463065556s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10652025-01-08T15:18:43.117ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_47ac6b17-3751-48c3-a4cf-463f53a56ba4
10662025-01-08T15:18:43.117ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_e42d62c1-ed16-4a81-9487-3eccfcc68fb0
10672025-01-08T15:18:43.117ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_5ae0abc8-2930-4671-9558-3abb8a50b674
10682025-01-08T15:18:43.117ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c
10692025-01-08T15:18:43.117ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_bc093a85-7eac-45fd-88b5-85a8e05d15e7
10702025-01-08T15:18:43.117ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10712025-01-08T15:18:43.118ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10722025-01-08T15:18:43.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21717199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40632 req_id = 7a765cc3-5891-4bab-93f3-365151e8b139 response_code = 204 uri = /omicron-zones
10732025-01-08T15:18:43.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:32784
10742025-01-08T15:18:43.178ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = 9ac7b97e-5b4c-4689-b7db-29e4e00afdfa response_code = 500 uri = /cockroachdb
10752025-01-08T15:18:43.178ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9ac7b97e-5b4c-4689-b7db-29e4e00afdfa", "content-length": "124", "date": "Wed, 08 Jan 2025 15:18:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9ac7b97e-5b4c-4689-b7db-29e4e00afdfa" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 85.890901ms
10762025-01-08T15:18:43.294ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28169 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = e0ca3979-55cb-47ad-8a3d-48ee82f771b6 response_code = 500 uri = /cockroachdb
10772025-01-08T15:18:43.294ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e0ca3979-55cb-47ad-8a3d-48ee82f771b6", "content-length": "124", "date": "Wed, 08 Jan 2025 15:18:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e0ca3979-55cb-47ad-8a3d-48ee82f771b6" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 171.775043ms
10782025-01-08T15:18:43.493ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = 8ba28985-94fe-4f2a-9560-b3228ebc4826 response_code = 500 uri = /cockroachdb
10792025-01-08T15:18:43.493ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8ba28985-94fe-4f2a-9560-b3228ebc4826", "content-length": "124", "date": "Wed, 08 Jan 2025 15:18:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8ba28985-94fe-4f2a-9560-b3228ebc4826" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 119.641712ms
10802025-01-08T15:18:43.637ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 23956 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = 64c3e491-f706-45e9-9fb5-1194198afed1 response_code = 500 uri = /cockroachdb
10812025-01-08T15:18:43.637ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "64c3e491-f706-45e9-9fb5-1194198afed1", "content-length": "124", "date": "Wed, 08 Jan 2025 15:18:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "64c3e491-f706-45e9-9fb5-1194198afed1" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 188.804832ms
10822025-01-08T15:18:43.853ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25538 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = 241f3e1d-2a48-412f-9206-8b5816b9c4d3 response_code = 500 uri = /cockroachdb
10832025-01-08T15:18:43.853ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "241f3e1d-2a48-412f-9206-8b5816b9c4d3", "content-length": "124", "date": "Wed, 08 Jan 2025 15:18:43 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "241f3e1d-2a48-412f-9206-8b5816b9c4d3" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 273.497268ms
10842025-01-08T15:18:44.154ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25643 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = 0472f806-1911-46e0-bc59-c710893dfb6e response_code = 500 uri = /cockroachdb
10852025-01-08T15:18:44.154ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0472f806-1911-46e0-bc59-c710893dfb6e", "content-length": "124", "date": "Wed, 08 Jan 2025 15:18:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0472f806-1911-46e0-bc59-c710893dfb6e" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 185.070121ms
10862025-01-08T15:18:44.365ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = cb1a4cbe-4c9a-4c5b-9e5c-e4442729dd8c response_code = 500 uri = /cockroachdb
10872025-01-08T15:18:44.366ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cb1a4cbe-4c9a-4c5b-9e5c-e4442729dd8c", "content-length": "124", "date": "Wed, 08 Jan 2025 15:18:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cb1a4cbe-4c9a-4c5b-9e5c-e4442729dd8c" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 358.943002ms
10882025-01-08T15:18:44.753ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26752 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = 2f7b1796-a4c6-4f56-9d89-63481587fb4c response_code = 500 uri = /cockroachdb
10892025-01-08T15:18:44.753ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2f7b1796-a4c6-4f56-9d89-63481587fb4c", "content-length": "124", "date": "Wed, 08 Jan 2025 15:18:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2f7b1796-a4c6-4f56-9d89-63481587fb4c" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 519.663543ms
10902025-01-08T15:18:45.300ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_245e5f95-a031-4715-b999-dae6bd50878c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26175 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = c358393d-dada-476d-b145-00c913702d14 response_code = 500 uri = /cockroachdb
10912025-01-08T15:18:45.300ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c358393d-dada-476d-b145-00c913702d14", "content-length": "124", "date": "Wed, 08 Jan 2025 15:18:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c358393d-dada-476d-b145-00c913702d14" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 332.010255ms
10922025-01-08T15:18:45.667ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3769
10932025-01-08T15:19:02.156ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
10942025-01-08T15:19:06.891ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3810
10952025-01-08T15:19:06.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21261823 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:32784 req_id = c2d4d15b-0c50-47ea-97d5-8eeca1aebaeb response_code = 204 uri = /cockroachdb
10962025-01-08T15:19:06.904ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 774.227643ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
10972025-01-08T15:19:06.938ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: c83545e9-4211-4dca-9ec0-0f110abfca92 (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: ea871c24-fe68-43ce-af24-67c6f74ea37d (service), filesystem_pool: Some(ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: bd3e994a-ca27-4475-b826-d1843113ddee (service), filesystem_pool: Some(ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: fc82a29b-8b06-4b52-a244-265ce127d51d (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 2fcf31ef-f2bb-46da-9d86-d94cad77ac17, kind: Service { id: fc82a29b-8b06-4b52-a244-265ce127d51d }, name: Name("ntp-fc82a29b-8b06-4b52-a244-265ce127d51d"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 159])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: bc093a85-7eac-45fd-88b5-85a8e05d15e7 (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } } } }, OmicronZoneConfig { id: 47ac6b17-3751-48c3-a4cf-463f53a56ba4 (service), filesystem_pool: Some(ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External } } } }, OmicronZoneConfig { id: 245e5f95-a031-4715-b999-dae6bd50878c (service), filesystem_pool: Some(ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: e42d62c1-ed16-4a81-9487-3eccfcc68fb0 (service), filesystem_pool: Some(ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ae0abc8-2930-4671-9558-3abb8a50b674 (service), filesystem_pool: Some(ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 546529ac-9cd3-4187-a253-14c651454456 (service), filesystem_pool: Some(ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f (service), filesystem_pool: Some(ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 4cece465-e930-47ca-aa88-ed170e15d28a (service), filesystem_pool: Some(ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 (service), filesystem_pool: Some(ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: f71f2083-2d2b-4618-9504-0628977ed486 (service), filesystem_pool: Some(ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: f07302d6-5a35-4f4a-b2f3-512aad5758f8 (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } } } }, OmicronZoneConfig { id: 626b8837-d5f3-44b3-92c0-8b87490e31f0 (service), filesystem_pool: Some(ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: f817b40a-6824-43ed-a642-2affe6d0e5d2 (service), filesystem_pool: Some(ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d (service), filesystem_pool: Some(ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5 (service), filesystem_pool: Some(ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External } } } }, OmicronZoneConfig { id: 4ed53420-7306-4ff6-b45e-505f92545bd0 (service), filesystem_pool: Some(ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External } } } }, OmicronZoneConfig { id: b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3 (service), filesystem_pool: Some(ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6cec6943-576a-45cf-af9a-4c0c9fbea7c9 (service), filesystem_pool: Some(ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 39da0641-b021-49a7-83dc-b14b4afdbdd3 (service), filesystem_pool: Some(ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6d66973c-dd41-4d43-b8ec-4e3299ba4486 (service), filesystem_pool: Some(ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7d213cfc-5b24-49d3-bd16-997a1a88dd43 (service), filesystem_pool: Some(ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External } } } }, OmicronZoneConfig { id: d4dcb42b-9dcc-4c5f-9deb-8b22b959a304 (service), filesystem_pool: Some(ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External } } } }, OmicronZoneConfig { id: 5db30132-02a4-425d-a07b-6ae7e64e9032 (service), filesystem_pool: Some(ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10982025-01-08T15:19:06.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46250
10992025-01-08T15:19:06.942ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11002025-01-08T15:19:06.942ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11012025-01-08T15:19:06.960ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11022025-01-08T15:19:06.960ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11032025-01-08T15:19:06.971ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11042025-01-08T15:19:06.971ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11052025-01-08T15:19:06.982ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11062025-01-08T15:19:06.982ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11072025-01-08T15:19:06.992ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11082025-01-08T15:19:06.992ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11092025-01-08T15:19:07.003ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11102025-01-08T15:19:07.003ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11112025-01-08T15:19:07.015ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11122025-01-08T15:19:07.015ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11132025-01-08T15:19:07.025ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11142025-01-08T15:19:07.026ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11152025-01-08T15:19:07.036ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11162025-01-08T15:19:07.036ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11172025-01-08T15:19:07.047ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11182025-01-08T15:19:07.047ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11192025-01-08T15:19:07.059ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11202025-01-08T15:19:07.059ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11212025-01-08T15:19:07.070ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11222025-01-08T15:19:07.070ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, kind: Crucible }, responder: ... }
11232025-01-08T15:19:07.081ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11242025-01-08T15:19:07.081ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, kind: Crucible }, responder: ... }
11252025-01-08T15:19:07.091ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11262025-01-08T15:19:07.091ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, kind: Crucible }, responder: ... }
11272025-01-08T15:19:07.103ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11282025-01-08T15:19:07.103ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, kind: Crucible }, responder: ... }
11292025-01-08T15:19:07.114ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11302025-01-08T15:19:07.114ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, kind: Crucible }, responder: ... }
11312025-01-08T15:19:07.123ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11322025-01-08T15:19:07.123ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, kind: Crucible }, responder: ... }
11332025-01-08T15:19:07.134ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11342025-01-08T15:19:07.134ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, kind: Crucible }, responder: ... }
11352025-01-08T15:19:07.146ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11362025-01-08T15:19:07.146ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, kind: Crucible }, responder: ... }
11372025-01-08T15:19:07.158ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11382025-01-08T15:19:07.158ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, kind: Crucible }, responder: ... }
11392025-01-08T15:19:07.169ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11402025-01-08T15:19:07.169ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:177
11412025-01-08T15:19:07.170ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:177
11422025-01-08T15:19:07.170ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11432025-01-08T15:19:07.286ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11442025-01-08T15:19:07.286ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11452025-01-08T15:19:07.291ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11462025-01-08T15:19:07.291ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11472025-01-08T15:19:07.291ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11482025-01-08T15:19:07.292ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11492025-01-08T15:19:07.340ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11502025-01-08T15:19:07.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11512025-01-08T15:19:07.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11522025-01-08T15:19:07.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11532025-01-08T15:19:07.340ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11542025-01-08T15:19:07.553ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11552025-01-08T15:19:07.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11562025-01-08T15:19:07.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11572025-01-08T15:19:07.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11582025-01-08T15:19:07.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11592025-01-08T15:19:07.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11602025-01-08T15:19:07.553ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11612025-01-08T15:19:07.565ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11622025-01-08T15:19:07.565ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43 file = illumos-utils/src/zone.rs:325
11632025-01-08T15:19:07.572ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486 file = illumos-utils/src/zone.rs:325
11642025-01-08T15:19:07.576ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0 file = illumos-utils/src/zone.rs:325
11652025-01-08T15:19:07.581ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2 file = illumos-utils/src/zone.rs:325
11662025-01-08T15:19:07.587ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3 file = illumos-utils/src/zone.rs:325
11672025-01-08T15:19:07.592ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9 file = illumos-utils/src/zone.rs:325
11682025-01-08T15:19:07.597ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0 file = illumos-utils/src/zone.rs:325
11692025-01-08T15:19:07.746ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43 file = illumos-utils/src/zone.rs:363
11702025-01-08T15:19:07.751ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486 file = illumos-utils/src/zone.rs:363
11712025-01-08T15:19:07.756ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0 file = illumos-utils/src/zone.rs:363
11722025-01-08T15:19:07.760ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2 file = illumos-utils/src/zone.rs:363
11732025-01-08T15:19:07.766ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3 file = illumos-utils/src/zone.rs:363
11742025-01-08T15:19:07.771ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9 file = illumos-utils/src/zone.rs:363
11752025-01-08T15:19:07.776ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0 file = illumos-utils/src/zone.rs:363
11762025-01-08T15:19:07.782ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8 file = illumos-utils/src/zone.rs:325
11772025-01-08T15:19:07.786ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3 file = illumos-utils/src/zone.rs:325
11782025-01-08T15:19:07.792ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486 file = illumos-utils/src/zone.rs:325
11792025-01-08T15:19:07.797ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304 file = illumos-utils/src/zone.rs:325
11802025-01-08T15:19:07.803ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032 file = illumos-utils/src/zone.rs:325
11812025-01-08T15:19:07.809ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d file = illumos-utils/src/zone.rs:325
11822025-01-08T15:19:07.814ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5 file = illumos-utils/src/zone.rs:325
11832025-01-08T15:19:07.881ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11842025-01-08T15:19:07.881ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8 file = illumos-utils/src/zone.rs:363
11852025-01-08T15:19:07.890ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3 file = illumos-utils/src/zone.rs:363
11862025-01-08T15:19:07.898ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486 file = illumos-utils/src/zone.rs:363
11872025-01-08T15:19:07.907ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304 file = illumos-utils/src/zone.rs:363
11882025-01-08T15:19:07.914ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032 file = illumos-utils/src/zone.rs:363
11892025-01-08T15:19:07.923ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d file = illumos-utils/src/zone.rs:363
11902025-01-08T15:19:07.932ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5 file = illumos-utils/src/zone.rs:363
11912025-01-08T15:19:07.999ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11922025-01-08T15:19:08.057ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11932025-01-08T15:19:08.115ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11942025-01-08T15:19:08.173ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11952025-01-08T15:19:08.174ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11962025-01-08T15:19:08.174ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11972025-01-08T15:19:08.240ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 176, 156]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11982025-01-08T15:19:08.240ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
11992025-01-08T15:19:08.247ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12002025-01-08T15:19:08.247ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12012025-01-08T15:19:08.302ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 181, 200]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12022025-01-08T15:19:08.302ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12032025-01-08T15:19:08.304ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12042025-01-08T15:19:08.304ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12052025-01-08T15:19:08.357ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 240, 16]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12062025-01-08T15:19:08.357ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
12072025-01-08T15:19:08.359ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12082025-01-08T15:19:08.359ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12092025-01-08T15:19:08.413ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 210, 34]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12102025-01-08T15:19:08.413ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
12112025-01-08T15:19:08.416ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12122025-01-08T15:19:08.416ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12132025-01-08T15:19:08.473ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 208, 157]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12142025-01-08T15:19:08.473ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
12152025-01-08T15:19:08.474ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12162025-01-08T15:19:08.475ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12172025-01-08T15:19:08.475ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12182025-01-08T15:19:08.475ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12192025-01-08T15:19:08.475ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12202025-01-08T15:19:08.475ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12212025-01-08T15:19:08.475ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12222025-01-08T15:19:08.475ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12232025-01-08T15:19:08.475ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12242025-01-08T15:19:08.475ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12252025-01-08T15:19:08.481ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12262025-01-08T15:19:08.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12272025-01-08T15:19:08.539ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12282025-01-08T15:19:08.542ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12292025-01-08T15:19:08.545ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12302025-01-08T15:19:08.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12312025-01-08T15:19:08.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12322025-01-08T15:19:08.549ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12332025-01-08T15:19:08.552ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12342025-01-08T15:19:08.552ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12352025-01-08T15:19:08.757ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456 file = illumos-utils/src/zone.rs:325
12362025-01-08T15:19:08.771ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6 file = illumos-utils/src/zone.rs:325
12372025-01-08T15:19:08.785ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f file = illumos-utils/src/zone.rs:325
12382025-01-08T15:19:08.817ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a file = illumos-utils/src/zone.rs:325
12392025-01-08T15:19:08.840ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 file = illumos-utils/src/zone.rs:325
12402025-01-08T15:19:08.888ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456 file = illumos-utils/src/zone.rs:363
12412025-01-08T15:19:08.918ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6 file = illumos-utils/src/zone.rs:363
12422025-01-08T15:19:08.963ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f file = illumos-utils/src/zone.rs:363
12432025-01-08T15:19:09.001ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a file = illumos-utils/src/zone.rs:363
12442025-01-08T15:19:09.076ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 file = illumos-utils/src/zone.rs:363
12452025-01-08T15:19:11.258ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12462025-01-08T15:19:11.259ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12472025-01-08T15:19:11.260ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
12482025-01-08T15:19:11.271ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
12492025-01-08T15:19:11.447ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12502025-01-08T15:19:11.447ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
12512025-01-08T15:19:11.480ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2838adfd-6724-4d11-9727-968f07762cf0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0d29577b-cb33-4a0b-9d64-18005d10ad2a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12522025-01-08T15:19:11.481ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fcc648e7-154b-42fe-a94d-5e4d5d99fa24'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12532025-01-08T15:19:11.481ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
12542025-01-08T15:19:11.501ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
12552025-01-08T15:19:11.532ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fc8117c6-ea55-4d90-948c-9f5cb860008f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12562025-01-08T15:19:11.532ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9ff0c6e9-6e4f-494e-9071-e5ffa542bfe3'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12572025-01-08T15:19:11.532ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='af48316d-f75f-481f-9ce9-431ea0aa7f2f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12582025-01-08T15:19:11.533ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
12592025-01-08T15:19:11.544ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
12602025-01-08T15:19:11.579ZINFOSledAgent (ServiceManager): Booting oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
12612025-01-08T15:19:13.023ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f80f84fb-0d35-46c9-a329-b7397a036f55/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='260bccaf-3e88-4558-9172-7a707d6efa14'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12622025-01-08T15:19:13.032ZINFOSledAgent (ServiceManager): Booting oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
12632025-01-08T15:19:13.035ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4c668202-5800-41df-b6d8-5ba0bc73bc2c'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12642025-01-08T15:19:13.036ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
12652025-01-08T15:19:13.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 37.881155ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
12662025-01-08T15:19:13.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 49.087969ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
12672025-01-08T15:19:13.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 57.786848ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
12682025-01-08T15:19:13.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 130.084631ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
12692025-01-08T15:19:13.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 47.533121ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
12702025-01-08T15:19:15.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 99.402514ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
12712025-01-08T15:19:15.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 58.034291ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
12722025-01-08T15:19:15.122ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='f71f2083-2d2b-4618-9504-0628977ed486'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12732025-01-08T15:19:15.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 157.802032ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
12742025-01-08T15:19:15.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 119.87724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
12752025-01-08T15:19:15.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 64.769175ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
12762025-01-08T15:19:15.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 136.740807ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
12772025-01-08T15:19:15.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 274.038204ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
12782025-01-08T15:19:15.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 53.506905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
12792025-01-08T15:19:15.270ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
12802025-01-08T15:19:15.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 61.439764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
12812025-01-08T15:19:15.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 102.129634ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
12822025-01-08T15:19:15.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 47.848832ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
12832025-01-08T15:19:15.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 160.067006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
12842025-01-08T15:19:15.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 217.763501ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
12852025-01-08T15:19:15.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 271.699114ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
12862025-01-08T15:19:15.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 118.067302ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
12872025-01-08T15:19:15.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 269.873448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
12882025-01-08T15:19:15.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 202.622244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
12892025-01-08T15:19:15.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 94.929981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
12902025-01-08T15:19:15.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 450.133952ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
12912025-01-08T15:19:15.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 373.414333ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
12922025-01-08T15:19:15.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 206.297863ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
12932025-01-08T15:19:15.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 131.862276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
12942025-01-08T15:19:15.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 270.653962ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
12952025-01-08T15:19:15.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 669.442867ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
12962025-01-08T15:19:15.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 354.0447ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
12972025-01-08T15:19:15.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 72.52961ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
12982025-01-08T15:19:15.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 529.032255ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
12992025-01-08T15:19:15.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 433.825337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
13002025-01-08T15:19:15.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 61.75563ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
13012025-01-08T15:19:15.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 1.006961544s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
13022025-01-08T15:19:15.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 147.286254ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
13032025-01-08T15:19:16.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 463.187982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
13042025-01-08T15:19:16.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 1.158043022s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
13052025-01-08T15:19:16.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 433.37749ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
13062025-01-08T15:19:16.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 364.14421ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
13072025-01-08T15:19:16.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.182604959s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
13082025-01-08T15:19:16.202ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b68c2a96-30ec-49d6-a55f-078a6befe678/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='52b34b3c-af0d-46cb-97ea-58eca7006dc2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13092025-01-08T15:19:16.203ZINFOSledAgent (ServiceManager): Booting oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
13102025-01-08T15:19:16.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 519.305558ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
13112025-01-08T15:19:16.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 832.21883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
13122025-01-08T15:19:16.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.058743811s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
13132025-01-08T15:19:16.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 72.006347ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
13142025-01-08T15:19:16.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 672.45825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
13152025-01-08T15:19:16.494ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2bc669d0-0094-4137-bc22-36487a33d705/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='50881051-edea-409a-ad76-492c951d2c24'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13162025-01-08T15:19:16.496ZINFOSledAgent (ServiceManager): Booting oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
13172025-01-08T15:19:16.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 642.803038ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
13182025-01-08T15:19:16.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 85.31043ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
13192025-01-08T15:19:16.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.244421454s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
13202025-01-08T15:19:16.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 281.15654ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
13212025-01-08T15:19:16.706ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13222025-01-08T15:19:16.707ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
13232025-01-08T15:19:16.717ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13242025-01-08T15:19:16.727ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
13252025-01-08T15:19:16.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 72.095171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
13262025-01-08T15:19:16.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 737.831337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
13272025-01-08T15:19:16.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 102.86614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
13282025-01-08T15:19:16.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 1.343201206s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
13292025-01-08T15:19:16.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 485.37051ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
13302025-01-08T15:19:16.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 30.573964ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
13312025-01-08T15:19:17.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 55.663798ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
13322025-01-08T15:19:17.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 48.50475ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
13332025-01-08T15:19:17.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 101.806554ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
13342025-01-08T15:19:17.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 102.471642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
13352025-01-08T15:19:17.050ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13362025-01-08T15:19:17.050ZINFOSledAgent (ServiceManager): Booting oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
13372025-01-08T15:19:17.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 30.858336ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
13382025-01-08T15:19:17.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 74.485951ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
13392025-01-08T15:19:17.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 53.14783ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
13402025-01-08T15:19:17.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 86.731514ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
13412025-01-08T15:19:17.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 434.991531ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
13422025-01-08T15:19:17.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 236.859566ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
13432025-01-08T15:19:17.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 282.638769ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
13442025-01-08T15:19:17.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 190.144686ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
13452025-01-08T15:19:17.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 1.031035759s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
13462025-01-08T15:19:17.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 806.836676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
13472025-01-08T15:19:17.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 1.055116215s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
13482025-01-08T15:19:17.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 178.893385ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
13492025-01-08T15:19:17.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 1.497758772s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
13502025-01-08T15:19:17.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 74.813286ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
13512025-01-08T15:19:17.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 705.210148ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
13522025-01-08T15:19:17.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 465.738829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
13532025-01-08T15:19:17.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 72.513546ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
13542025-01-08T15:19:17.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 290.41422ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
13552025-01-08T15:19:17.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 542.72662ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
13562025-01-08T15:19:17.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 506.565988ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
13572025-01-08T15:19:17.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 358.819018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
13582025-01-08T15:19:17.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 170.931941ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
13592025-01-08T15:19:17.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 870.908244ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
13602025-01-08T15:19:17.560ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13612025-01-08T15:19:17.561ZINFOSledAgent (ServiceManager): Booting oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
13622025-01-08T15:19:17.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 552.570395ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
13632025-01-08T15:19:17.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 575.770827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
13642025-01-08T15:19:17.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 393.278819ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
13652025-01-08T15:19:17.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 822.501202ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
13662025-01-08T15:19:17.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 50.208595ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
13672025-01-08T15:19:17.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 864.264479ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
13682025-01-08T15:19:17.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 876.296477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
13692025-01-08T15:19:17.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 510.230926ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
13702025-01-08T15:19:17.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 86.999623ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
13712025-01-08T15:19:18.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 281.636782ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
13722025-01-08T15:19:18.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 713.808949ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
13732025-01-08T15:19:18.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 947.185445ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
13742025-01-08T15:19:18.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 876.753088ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
13752025-01-08T15:19:18.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 854.599616ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
13762025-01-08T15:19:18.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.199888791s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
13772025-01-08T15:19:18.132ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13782025-01-08T15:19:18.135ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
13792025-01-08T15:19:18.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 517.244794ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
13802025-01-08T15:19:18.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 1.304720142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
13812025-01-08T15:19:18.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 1.214616506s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
13822025-01-08T15:19:18.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 733.113422ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
13832025-01-08T15:19:18.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 1.276889118s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
13842025-01-08T15:19:18.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 244.01962ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
13852025-01-08T15:19:18.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 1.072641142s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
13862025-01-08T15:19:18.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.194956601s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
13872025-01-08T15:19:18.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 64.579674ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
13882025-01-08T15:19:18.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 107.901286ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
13892025-01-08T15:19:18.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 1.230054617s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
13902025-01-08T15:19:18.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 482.090435ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
13912025-01-08T15:19:18.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 272.448975ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
13922025-01-08T15:19:19.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 1.412420091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
13932025-01-08T15:19:19.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 1.316679901s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
13942025-01-08T15:19:19.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 1.402439896s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
13952025-01-08T15:19:19.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 493.9532ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
13962025-01-08T15:19:19.235ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 1.068403401s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
13972025-01-08T15:19:19.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 800.783427ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
13982025-01-08T15:19:19.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 773.455453ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
13992025-01-08T15:19:19.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 1.388213161s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
14002025-01-08T15:19:19.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 504.631257ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
14012025-01-08T15:19:19.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.381964017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
14022025-01-08T15:19:19.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 730.91536ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
14032025-01-08T15:19:19.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 616.068557ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
14042025-01-08T15:19:19.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 1.496350904s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
14052025-01-08T15:19:19.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 515.874961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
14062025-01-08T15:19:19.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 544.498644ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
14072025-01-08T15:19:19.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 616.45662ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
14082025-01-08T15:19:19.615ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.041121607s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
14092025-01-08T15:19:19.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.108504543s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
14102025-01-08T15:19:19.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 1.209854339s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
14112025-01-08T15:19:19.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 838.992928ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
14122025-01-08T15:19:19.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 737.999579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
14132025-01-08T15:19:20.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 749.685545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
14142025-01-08T15:19:20.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 1.003588448s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
14152025-01-08T15:19:20.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 1.325530216s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
14162025-01-08T15:19:20.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 710.95348ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
14172025-01-08T15:19:20.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 996.860303ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
14182025-01-08T15:19:20.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 528.044438ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
14192025-01-08T15:19:20.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 1.362927149s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
14202025-01-08T15:19:20.492ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 711.871117ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
14212025-01-08T15:19:20.510ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 1.229037917s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
14222025-01-08T15:19:20.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 687.250511ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
14232025-01-08T15:19:20.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 909.458265ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
14242025-01-08T15:19:20.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 873.995856ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
14252025-01-08T15:19:20.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 1.052405949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
14262025-01-08T15:19:20.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.275276277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
14272025-01-08T15:19:20.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.117795316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
14282025-01-08T15:19:20.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 691.876363ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
14292025-01-08T15:19:20.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 1.066812829s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
14302025-01-08T15:19:20.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 733.778524ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
14312025-01-08T15:19:20.851ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 730.975408ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
14322025-01-08T15:19:20.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 1.148632568s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
14332025-01-08T15:19:21.023ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 771.010027ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
14342025-01-08T15:19:21.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 810.639913ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
14352025-01-08T15:19:21.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 1.207862934s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
14362025-01-08T15:19:21.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 1.057624534s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
14372025-01-08T15:19:21.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 1.219269644s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
14382025-01-08T15:19:21.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 1.329643595s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
14392025-01-08T15:19:21.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 1.137544665s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
14402025-01-08T15:19:21.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 1.473360925s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
14412025-01-08T15:19:21.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 915.11764ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
14422025-01-08T15:19:21.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.437936371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
14432025-01-08T15:19:21.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.174854361s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
14442025-01-08T15:19:21.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 1.459646277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
14452025-01-08T15:19:21.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 510.771977ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
14462025-01-08T15:19:21.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 1.242669838s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
14472025-01-08T15:19:21.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 1.04982323s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
14482025-01-08T15:19:21.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 595.276883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
14492025-01-08T15:19:21.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 781.132565ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
14502025-01-08T15:19:21.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 653.938126ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
14512025-01-08T15:19:21.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.482370537s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
14522025-01-08T15:19:22.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 673.782508ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
14532025-01-08T15:19:22.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 1.171508683s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
14542025-01-08T15:19:22.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 934.530399ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
14552025-01-08T15:19:22.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 1.411386845s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
14562025-01-08T15:19:22.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 1.434721953s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
14572025-01-08T15:19:22.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 1.171823937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
14582025-01-08T15:19:22.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 705.515021ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
14592025-01-08T15:19:22.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 736.142752ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
14602025-01-08T15:19:22.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 800.511886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
14612025-01-08T15:19:22.664ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.375859072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
14622025-01-08T15:19:22.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 1.328118938s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
14632025-01-08T15:19:22.796ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.047701407s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
14642025-01-08T15:19:22.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.413070788s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
14652025-01-08T15:19:22.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 605.955018ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
14662025-01-08T15:19:22.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 1.188445738s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
14672025-01-08T15:19:22.917ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14682025-01-08T15:19:22.918ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
14692025-01-08T15:19:23.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 571.119376ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
14702025-01-08T15:19:23.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 727.017691ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
14712025-01-08T15:19:23.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 551.584386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
14722025-01-08T15:19:23.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 501.49947ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
14732025-01-08T15:19:23.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 39.200786ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
14742025-01-08T15:19:23.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 946.514406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
14752025-01-08T15:19:23.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 918.449173ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
14762025-01-08T15:19:23.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 90.961877ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
14772025-01-08T15:19:23.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 1.351922846s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
14782025-01-08T15:19:23.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 1.108955183s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
14792025-01-08T15:19:23.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 1.126536532s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
14802025-01-08T15:19:23.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.435235826s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
14812025-01-08T15:19:23.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 806.538876ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
14822025-01-08T15:19:23.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 241.141619ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
14832025-01-08T15:19:23.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 563.818743ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
14842025-01-08T15:19:23.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 1.296481484s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
14852025-01-08T15:19:23.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 899.20542ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
14862025-01-08T15:19:23.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.093117404s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
14872025-01-08T15:19:23.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 892.844361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
14882025-01-08T15:19:23.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 691.878444ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
14892025-01-08T15:19:24.116ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 940.023361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
14902025-01-08T15:19:24.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 973.969579ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
14912025-01-08T15:19:24.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 251.519706ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
14922025-01-08T15:19:24.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.209349401s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
14932025-01-08T15:19:24.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 827.534145ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
14942025-01-08T15:19:24.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 516.720082ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
14952025-01-08T15:19:24.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 1.190972797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
14962025-01-08T15:19:24.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 777.98125ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
14972025-01-08T15:19:24.304ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 1.047943091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
14982025-01-08T15:19:24.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 727.729919ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
14992025-01-08T15:19:24.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 1.266463197s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
15002025-01-08T15:19:24.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 997.977322ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
15012025-01-08T15:19:24.622ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59170
15022025-01-08T15:19:24.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 720.874463ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
15032025-01-08T15:19:24.884ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88864 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59170 req_id = c94edcd4-f189-49db-a67c-368fd49f37a6 response_code = 200 uri = /baseboard
15042025-01-08T15:19:24.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 945.578764ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
15052025-01-08T15:19:24.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 901.482449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
15062025-01-08T15:19:24.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.193585878s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
15072025-01-08T15:19:25.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 997.901231ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
15082025-01-08T15:19:25.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 567.600695ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
15092025-01-08T15:19:25.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 1.068225864s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
15102025-01-08T15:19:25.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.010383999s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
15112025-01-08T15:19:25.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 1.372196536s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
15122025-01-08T15:19:25.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 987.440749ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
15132025-01-08T15:19:25.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 1.255150413s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
15142025-01-08T15:19:25.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 1.208096092s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
15152025-01-08T15:19:25.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 620.67825ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
15162025-01-08T15:19:25.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 1.153129668s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
15172025-01-08T15:19:25.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 809.566365ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
15182025-01-08T15:19:25.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.13834889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
15192025-01-08T15:19:25.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 1.457429785s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
15202025-01-08T15:19:25.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 713.207449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
15212025-01-08T15:19:25.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 978.404656ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
15222025-01-08T15:19:25.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 1.299485016s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
15232025-01-08T15:19:25.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.109966588s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
15242025-01-08T15:19:25.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 620.247598ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
15252025-01-08T15:19:25.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 725.649351ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
15262025-01-08T15:19:25.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 751.070824ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
15272025-01-08T15:19:26.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 1.193769252s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
15282025-01-08T15:19:26.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.359328484s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
15292025-01-08T15:19:26.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 921.125918ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
15302025-01-08T15:19:26.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 809.811222ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
15312025-01-08T15:19:26.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 826.222221ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
15322025-01-08T15:19:26.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 815.310742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
15332025-01-08T15:19:26.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 1.117383488s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
15342025-01-08T15:19:26.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 619.148261ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
15352025-01-08T15:19:26.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 1.008296982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
15362025-01-08T15:19:26.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 575.352735ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
15372025-01-08T15:19:26.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 852.182464ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
15382025-01-08T15:19:26.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 524.274142ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
15392025-01-08T15:19:26.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 648.06013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
15402025-01-08T15:19:26.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 1.021096274s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
15412025-01-08T15:19:26.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 669.427606ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
15422025-01-08T15:19:26.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 761.944275ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
15432025-01-08T15:19:26.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.019778356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
15442025-01-08T15:19:26.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 1.171523949s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
15452025-01-08T15:19:26.927ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 661.405757ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
15462025-01-08T15:19:26.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 1.319723427s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
15472025-01-08T15:19:26.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 919.225309ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
15482025-01-08T15:19:26.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 683.493219ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
15492025-01-08T15:19:26.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 616.159911ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
15502025-01-08T15:19:27.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.130098871s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
15512025-01-08T15:19:27.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 720.249745ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
15522025-01-08T15:19:27.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 1.153478605s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
15532025-01-08T15:19:27.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 589.434906ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
15542025-01-08T15:19:27.242ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 1.17909721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
15552025-01-08T15:19:27.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 656.329145ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
15562025-01-08T15:19:27.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 1.352947661s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
15572025-01-08T15:19:27.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 773.317866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
15582025-01-08T15:19:27.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 856.745669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
15592025-01-08T15:19:27.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 1.060303816s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
15602025-01-08T15:19:27.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 551.403182ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
15612025-01-08T15:19:27.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 965.660097ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
15622025-01-08T15:19:27.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 1.045710654s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
15632025-01-08T15:19:27.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 1.428410429s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
15642025-01-08T15:19:27.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 869.767329ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
15652025-01-08T15:19:27.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 850.507847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
15662025-01-08T15:19:27.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.03118902s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
15672025-01-08T15:19:27.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 1.471451275s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
15682025-01-08T15:19:27.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.470665875s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
15692025-01-08T15:19:27.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 1.20724428s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
15702025-01-08T15:19:28.017ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 533.964298ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
15712025-01-08T15:19:28.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 657.088545ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
15722025-01-08T15:19:28.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.423429612s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
15732025-01-08T15:19:28.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 1.071095291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
15742025-01-08T15:19:28.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 1.362295584s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
15752025-01-08T15:19:28.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 746.275819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
15762025-01-08T15:19:28.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 980.992087ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
15772025-01-08T15:19:28.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 1.264334592s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
15782025-01-08T15:19:28.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 803.49054ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
15792025-01-08T15:19:28.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 1.208619857s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
15802025-01-08T15:19:28.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 1.06274299s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
15812025-01-08T15:19:28.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 678.04948ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
15822025-01-08T15:19:28.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 1.268218131s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
15832025-01-08T15:19:28.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 544.409586ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
15842025-01-08T15:19:28.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 1.07153552s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
15852025-01-08T15:19:28.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 1.288717567s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
15862025-01-08T15:19:28.849ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.119319466s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
15872025-01-08T15:19:29.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 589.716124ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
15882025-01-08T15:19:29.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 744.358866ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
15892025-01-08T15:19:29.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 1.369176961s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
15902025-01-08T15:19:29.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 1.073977089s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
15912025-01-08T15:19:29.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 656.674423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
15922025-01-08T15:19:29.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.130830509s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
15932025-01-08T15:19:29.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 1.010003665s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
15942025-01-08T15:19:29.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 1.14630194s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
15952025-01-08T15:19:29.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 530.602453ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
15962025-01-08T15:19:29.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 910.15089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
15972025-01-08T15:19:29.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 638.170864ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
15982025-01-08T15:19:29.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.039576211s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
15992025-01-08T15:19:29.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 1.082019308s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
16002025-01-08T15:19:29.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 921.874805ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
16012025-01-08T15:19:29.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 895.701855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
16022025-01-08T15:19:29.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 988.28941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
16032025-01-08T15:19:29.766ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 1.079208374s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
16042025-01-08T15:19:29.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 595.941085ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
16052025-01-08T15:19:29.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 1.165570797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
16062025-01-08T15:19:29.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 1.436778899s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
16072025-01-08T15:19:29.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 1.141242807s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
16082025-01-08T15:19:29.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.024696693s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
16092025-01-08T15:19:30.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 744.677001ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
16102025-01-08T15:19:30.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 730.004196ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
16112025-01-08T15:19:30.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 1.416509397s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
16122025-01-08T15:19:30.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 949.406819ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
16132025-01-08T15:19:30.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 871.176682ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
16142025-01-08T15:19:30.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.208813135s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
16152025-01-08T15:19:30.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 719.4448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
16162025-01-08T15:19:30.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 1.261234356s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
16172025-01-08T15:19:30.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 1.133996066s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
16182025-01-08T15:19:30.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 957.379933ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
16192025-01-08T15:19:30.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 1.046127371s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
16202025-01-08T15:19:30.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.388562884s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
16212025-01-08T15:19:30.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 812.017598ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
16222025-01-08T15:19:30.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 910.427483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
16232025-01-08T15:19:30.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 707.088138ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
16242025-01-08T15:19:30.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 1.34836562s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
16252025-01-08T15:19:30.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 1.390957209s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
16262025-01-08T15:19:31.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 575.595325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
16272025-01-08T15:19:31.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 1.169227971s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
16282025-01-08T15:19:31.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 785.382285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
16292025-01-08T15:19:31.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 729.926809ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
16302025-01-08T15:19:31.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 917.447518ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
16312025-01-08T15:19:31.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 959.327333ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
16322025-01-08T15:19:31.350ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 729.280477ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
16332025-01-08T15:19:31.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 943.809977ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
16342025-01-08T15:19:31.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 843.407979ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
16352025-01-08T15:19:31.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 674.136425ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
16362025-01-08T15:19:31.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.018420423s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
16372025-01-08T15:19:31.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.071134462s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
16382025-01-08T15:19:31.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 1.122077611s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
16392025-01-08T15:19:31.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 970.278615ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
16402025-01-08T15:19:31.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 1.435630362s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
16412025-01-08T15:19:31.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 937.648294ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
16422025-01-08T15:19:31.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 677.311028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
16432025-01-08T15:19:31.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 948.125156ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
16442025-01-08T15:19:31.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 1.334192139s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
16452025-01-08T15:19:32.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 1.440007919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
16462025-01-08T15:19:32.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 781.726318ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
16472025-01-08T15:19:32.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.211739219s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
16482025-01-08T15:19:32.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 1.323079546s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
16492025-01-08T15:19:32.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 893.507633ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
16502025-01-08T15:19:32.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 1.347669797s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
16512025-01-08T15:19:32.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 743.998014ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
16522025-01-08T15:19:32.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456") failed: Property not found. retry in 1.471154825s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
16532025-01-08T15:19:32.385ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 961.430779ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
16542025-01-08T15:19:32.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 959.65573ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
16552025-01-08T15:19:32.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 1.438865325s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
16562025-01-08T15:19:32.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.014703558s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
16572025-01-08T15:19:32.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 517.686647ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
16582025-01-08T15:19:32.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 1.379582992s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
16592025-01-08T15:19:32.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.093239586s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
16602025-01-08T15:19:32.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 920.173754ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
16612025-01-08T15:19:32.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 1.074864343s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
16622025-01-08T15:19:32.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 713.198099ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
16632025-01-08T15:19:32.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 659.818421ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
16642025-01-08T15:19:33.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f") failed: Property not found. retry in 1.082495113s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
16652025-01-08T15:19:33.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60") failed: Property not found. retry in 1.179545622s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
16662025-01-08T15:19:33.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43") failed: Property not found. retry in 764.845198ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
16672025-01-08T15:19:33.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486") failed: Property not found. retry in 1.425481115s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
16682025-01-08T15:19:33.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2") failed: Property not found. retry in 1.228743997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
16692025-01-08T15:19:33.355ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9") failed: Property not found. retry in 1.093791846s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
16702025-01-08T15:19:33.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032") failed: Property not found. retry in 1.175881475s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
16712025-01-08T15:19:33.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d") failed: Property not found. retry in 950.509639ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
16722025-01-08T15:19:33.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3") failed: Property not found. retry in 1.259867753s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
16732025-01-08T15:19:33.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 977.368146ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
16742025-01-08T15:19:33.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0") failed: Property not found. retry in 1.239449982s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
16752025-01-08T15:19:33.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304") failed: Property not found. retry in 1.043202084s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
16762025-01-08T15:19:33.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 503.953567ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
16772025-01-08T15:19:33.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5") failed: Property not found. retry in 1.361368192s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
16782025-01-08T15:19:33.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a") failed: Property not found. retry in 1.086349279s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
16792025-01-08T15:19:33.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3") failed: Property not found. retry in 1.237027469s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
16802025-01-08T15:19:33.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0") failed: Property not found. retry in 910.584397ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
16812025-01-08T15:19:34.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 1.043433566s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
16822025-01-08T15:19:34.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486") failed: Property not found. retry in 702.865128ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
16832025-01-08T15:19:34.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6") failed: Property not found. retry in 1.172415349s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
16842025-01-08T15:19:35.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 1.146991142s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
16852025-01-08T15:19:36.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8") failed: Property not found. retry in 1.371845028s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
16862025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_7d213cfc-5b24-49d3-bd16-997a1a88dd43
16872025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_caa67412-bbaa-4cb8-ab7d-76f354f43ac6
16882025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_oximeter_f71f2083-2d2b-4618-9504-0628977ed486
16892025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_626b8837-d5f3-44b3-92c0-8b87490e31f0
16902025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_d06eb9fe-b4bf-480e-8744-c75f332edb8f
16912025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_4cece465-e930-47ca-aa88-ed170e15d28a
16922025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_f817b40a-6824-43ed-a642-2affe6d0e5d2
16932025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_b0e8de8f-e5b1-4c49-bca7-5c6b7fd98ca3
16942025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_6cec6943-576a-45cf-af9a-4c0c9fbea7c9
16952025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_4ed53420-7306-4ff6-b45e-505f92545bd0
16962025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_4ac9516f-ce2b-441e-b6e1-c7e068dc9b60
16972025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_clickhouse_f07302d6-5a35-4f4a-b2f3-512aad5758f8
16982025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_39da0641-b021-49a7-83dc-b14b4afdbdd3
16992025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_6d66973c-dd41-4d43-b8ec-4e3299ba4486
17002025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_d4dcb42b-9dcc-4c5f-9deb-8b22b959a304
17012025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_5db30132-02a4-425d-a07b-6ae7e64e9032
17022025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_ef2f7d01-a348-4aa5-b9a4-ffb4fb386a4d
17032025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_546529ac-9cd3-4187-a253-14c651454456
17042025-01-08T15:19:37.734ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_6ea1daed-5d0b-4f05-8cec-9fcdb62cf7a5
17052025-01-08T15:19:37.741ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17062025-01-08T15:19:37.745ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17072025-01-08T15:19:37.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30833479 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:46250 req_id = cb0e87af-da62-423f-8850-c1c012c1fb66 response_code = 204 uri = /omicron-zones
17082025-01-08T15:19:37.783ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17092025-01-08T15:19:38.117ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17102025-01-08T15:19:38.131ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:803
17112025-01-08T15:19:38.188ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
17122025-01-08T15:19:39.104ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.173290671s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
17132025-01-08T15:19:39.831ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17142025-01-08T15:19:39.971ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17152025-01-08T15:19:40.061ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17162025-01-08T15:19:40.249ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17172025-01-08T15:19:40.502ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17182025-01-08T15:19:40.703ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17192025-01-08T15:19:41.045ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17202025-01-08T15:19:41.263ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17212025-01-08T15:19:41.787ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17222025-01-08T15:19:42.208ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17232025-01-08T15:19:42.724ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17242025-01-08T15:19:43.236ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/fa7d62e1-57d8-49cc-9dd2-a5f8873ea528/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
17252025-01-08T15:19:43.317ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.777441462s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
17262025-01-08T15:19:45.303ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1178f384-abcd-465c-8ad8-a85c51cebbbc", "content-length": "173", "date": "Wed, 08 Jan 2025 15:19:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"fa7d62e1-57d8-49cc-9dd2-a5f8873ea528\"", request_id: "1178f384-abcd-465c-8ad8-a85c51cebbbc" } file = sled-agent/src/rack_setup/service.rs:1079
17272025-01-08T15:19:47.355ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "155c3f4a-acff-42b1-bc13-37a3ab3e6bf7", "content-length": "173", "date": "Wed, 08 Jan 2025 15:19:47 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"fa7d62e1-57d8-49cc-9dd2-a5f8873ea528\"", request_id: "155c3f4a-acff-42b1-bc13-37a3ab3e6bf7" } file = sled-agent/src/rack_setup/service.rs:1079
17282025-01-08T15:19:48.375ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "270b8694-a1ef-44eb-b06c-c075b2c1edf2", "content-length": "173", "date": "Wed, 08 Jan 2025 15:19:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"fa7d62e1-57d8-49cc-9dd2-a5f8873ea528\"", request_id: "270b8694-a1ef-44eb-b06c-c075b2c1edf2" } file = sled-agent/src/rack_setup/service.rs:1079
17292025-01-08T15:19:51.132ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "97f00666-d4b0-4f9a-bd27-bbfa0ce2898b", "content-length": "173", "date": "Wed, 08 Jan 2025 15:19:50 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ba54f0e2-bde0-4da7-a58e-566dc5903c14\"", request_id: "97f00666-d4b0-4f9a-bd27-bbfa0ce2898b" } file = sled-agent/src/rack_setup/service.rs:1079
17302025-01-08T15:19:53.890ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "895ab2d6-d9ef-4159-9487-d05ad04dafc1", "content-length": "173", "date": "Wed, 08 Jan 2025 15:19:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ba54f0e2-bde0-4da7-a58e-566dc5903c14\"", request_id: "895ab2d6-d9ef-4159-9487-d05ad04dafc1" } file = sled-agent/src/rack_setup/service.rs:1079
17312025-01-08T15:19:54.978ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40195
17322025-01-08T15:19:54.978ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40195 req_id = a5cb9275-5bab-43dd-b782-dc9a969cf8d7 response_code = 200 uri = /baseboard
17332025-01-08T15:19:55.997ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "78fa7377-cf31-473f-bdc3-b0565a5b0960", "content-length": "173", "date": "Wed, 08 Jan 2025 15:19:55 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ba54f0e2-bde0-4da7-a58e-566dc5903c14\"", request_id: "78fa7377-cf31-473f-bdc3-b0565a5b0960" } file = sled-agent/src/rack_setup/service.rs:1079
17342025-01-08T15:19:57.523ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "554d5086-5cd7-4006-9bb1-3587e66b9cc0", "content-length": "173", "date": "Wed, 08 Jan 2025 15:19:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ba54f0e2-bde0-4da7-a58e-566dc5903c14\"", request_id: "554d5086-5cd7-4006-9bb1-3587e66b9cc0" } file = sled-agent/src/rack_setup/service.rs:1079
17352025-01-08T15:20:00.953ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9b372631-5c99-43b9-8ffb-233dd1314c06", "content-length": "173", "date": "Wed, 08 Jan 2025 15:20:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ba54f0e2-bde0-4da7-a58e-566dc5903c14\"", request_id: "9b372631-5c99-43b9-8ffb-233dd1314c06" } file = sled-agent/src/rack_setup/service.rs:1079
17362025-01-08T15:20:05.935ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "9706097a-0d73-4320-95f2-6907a641b717", "content-length": "173", "date": "Wed, 08 Jan 2025 15:20:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ba54f0e2-bde0-4da7-a58e-566dc5903c14\"", request_id: "9706097a-0d73-4320-95f2-6907a641b717" } file = sled-agent/src/rack_setup/service.rs:1079
17372025-01-08T15:20:11.072ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "457bdaa9-fc54-47d8-b9c9-2d28ded2671e", "content-length": "173", "date": "Wed, 08 Jan 2025 15:20:11 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ba54f0e2-bde0-4da7-a58e-566dc5903c14\"", request_id: "457bdaa9-fc54-47d8-b9c9-2d28ded2671e" } file = sled-agent/src/rack_setup/service.rs:1079
17382025-01-08T15:20:13.882ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "794a7c01-944e-42ca-86e4-3cd39f7cbd8a", "content-length": "173", "date": "Wed, 08 Jan 2025 15:20:13 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"ba54f0e2-bde0-4da7-a58e-566dc5903c14\"", request_id: "794a7c01-944e-42ca-86e4-3cd39f7cbd8a" } file = sled-agent/src/rack_setup/service.rs:1079
17392025-01-08T15:20:17.157ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
17402025-01-08T15:20:17.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47432
17412025-01-08T15:20:17.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17422025-01-08T15:20:17.257ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17432025-01-08T15:20:17.257ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:177
17442025-01-08T15:20:17.260ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:177
17452025-01-08T15:20:17.276ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17462025-01-08T15:20:17.276ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc669d0-0094-4137-bc22-36487a33d705
17472025-01-08T15:20:17.303ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17482025-01-08T15:20:17.303ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b68c2a96-30ec-49d6-a55f-078a6befe678
17492025-01-08T15:20:17.325ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17502025-01-08T15:20:17.325ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9
17512025-01-08T15:20:17.348ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17522025-01-08T15:20:17.348ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2838adfd-6724-4d11-9727-968f07762cf0
17532025-01-08T15:20:17.369ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17542025-01-08T15:20:17.369ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f80f84fb-0d35-46c9-a329-b7397a036f55
17552025-01-08T15:20:17.390ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17562025-01-08T15:20:17.390ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46
17572025-01-08T15:20:17.409ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17582025-01-08T15:20:17.409ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60
17592025-01-08T15:20:17.429ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17602025-01-08T15:20:17.429ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae
17612025-01-08T15:20:17.449ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17622025-01-08T15:20:17.449ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a
17632025-01-08T15:20:17.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207888 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47432 req_id = 0005b65b-33e0-4a5d-835c-4142907cafbd response_code = 200 uri = /inventory
17642025-01-08T15:20:18.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55239
17652025-01-08T15:20:18.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1799 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55239 req_id = a5555ad7-a7a0-4346-9651-727cd23e17b6 response_code = 200 uri = /vpc-routes
17662025-01-08T15:20:18.836ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
17672025-01-08T15:20:18.836ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55239 req_id = 17005c80-4760-4622-91ac-6dbf4c5d2c9c response_code = 204 uri = /eip-gateways
17682025-01-08T15:20:18.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35333
17692025-01-08T15:20:18.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35333 req_id = a6cc951c-5662-487c-a263-75285cb1b5c6 response_code = 200 uri = /vpc-routes
17702025-01-08T15:20:18.913ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51241
17712025-01-08T15:20:18.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1876 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51241 req_id = de0a85ea-f496-4d0a-8ac5-b145c18211ac response_code = 200 uri = /v2p
17722025-01-08T15:20:18.938ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
17732025-01-08T15:20:18.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35333 req_id = b17eef78-f646-41dc-bffe-5fe7b8ef10c1 response_code = 204 uri = /eip-gateways
17742025-01-08T15:20:18.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52323
17752025-01-08T15:20:18.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52323 req_id = 1cb53bfd-e2ca-4b2e-b7f1-130c93889491 response_code = 200 uri = /v2p
17762025-01-08T15:20:19.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55239 req_id = e0252d21-f1ca-4d9f-a486-4824932c6428 response_code = 204 uri = /vpc-routes
17772025-01-08T15:20:19.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62410
17782025-01-08T15:20:19.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62410 req_id = eb8be63a-4644-4cd5-800a-a7b5e7097084 response_code = 200 uri = /vpc-routes
17792025-01-08T15:20:19.042ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
17802025-01-08T15:20:19.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35333 req_id = 3185f42b-191b-4604-8434-537b85cdb383 response_code = 204 uri = /vpc-routes
17812025-01-08T15:20:19.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
17822025-01-08T15:20:19.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62410 req_id = 4c26b2e4-d992-43f1-8a86-9e6519682224 response_code = 204 uri = /eip-gateways
17832025-01-08T15:20:19.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62410 req_id = 7259e048-ca10-4bfd-a75f-1b69736ee66a response_code = 204 uri = /vpc-routes
17842025-01-08T15:20:19.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44184
17852025-01-08T15:20:19.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44184 req_id = 5eee770c-c0de-4130-9fa0-da0a9c97b82b response_code = 200 uri = /v2p
17862025-01-08T15:20:20.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65180
17872025-01-08T15:20:20.445ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17882025-01-08T15:20:20.445ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17892025-01-08T15:20:20.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17902025-01-08T15:20:20.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17912025-01-08T15:20:20.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17922025-01-08T15:20:20.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17932025-01-08T15:20:20.446ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17942025-01-08T15:20:20.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4382 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65180 req_id = 53310520-4266-4630-bb02-d20ef4614229 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17952025-01-08T15:20:20.447ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
17962025-01-08T15:20:20.452ZINFOSledAgent (RSS): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17972025-01-08T15:20:20.452ZINFOSledAgent (RSS): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17982025-01-08T15:20:20.637ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48511
17992025-01-08T15:20:20.637ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18002025-01-08T15:20:20.637ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
18012025-01-08T15:20:20.637ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:177
18022025-01-08T15:20:20.638ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:177
18032025-01-08T15:20:20.650ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18042025-01-08T15:20:20.650ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc669d0-0094-4137-bc22-36487a33d705
18052025-01-08T15:20:20.676ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18062025-01-08T15:20:20.676ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b68c2a96-30ec-49d6-a55f-078a6befe678
18072025-01-08T15:20:20.699ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18082025-01-08T15:20:20.699ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9
18092025-01-08T15:20:20.719ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18102025-01-08T15:20:20.719ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2838adfd-6724-4d11-9727-968f07762cf0
18112025-01-08T15:20:20.741ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18122025-01-08T15:20:20.741ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f80f84fb-0d35-46c9-a329-b7397a036f55
18132025-01-08T15:20:20.766ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18142025-01-08T15:20:20.766ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46
18152025-01-08T15:20:20.786ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18162025-01-08T15:20:20.786ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60
18172025-01-08T15:20:20.806ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18182025-01-08T15:20:20.806ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae
18192025-01-08T15:20:20.826ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
18202025-01-08T15:20:20.826ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a
18212025-01-08T15:20:20.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48511 req_id = 28822e09-a58b-4de1-aafa-460cd5e12453 response_code = 200 uri = /inventory
18222025-01-08T15:20:21.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41905
18232025-01-08T15:20:21.347ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18242025-01-08T15:20:21.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18252025-01-08T15:20:21.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18262025-01-08T15:20:21.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18272025-01-08T15:20:21.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18282025-01-08T15:20:21.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18292025-01-08T15:20:21.347ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18302025-01-08T15:20:21.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 315 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41905 req_id = 7e9d50b2-4d6c-44ea-9535-e39022035c75 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18312025-01-08T15:20:21.641ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43387
18322025-01-08T15:20:21.642ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18332025-01-08T15:20:21.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18342025-01-08T15:20:21.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18352025-01-08T15:20:21.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18362025-01-08T15:20:21.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18372025-01-08T15:20:21.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18382025-01-08T15:20:21.642ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18392025-01-08T15:20:21.642ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43387 req_id = 0b4092e5-5cdb-48d1-b863-065e03011a2e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18402025-01-08T15:20:22.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52604
18412025-01-08T15:20:22.247ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
18422025-01-08T15:20:22.247ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18432025-01-08T15:20:22.247ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
18442025-01-08T15:20:22.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18452025-01-08T15:20:22.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18462025-01-08T15:20:22.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
18472025-01-08T15:20:22.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
18482025-01-08T15:20:22.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 448 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52604 req_id = 4b70f250-9dc0-4768-b3a2-6419af7a4c3c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
18492025-01-08T15:20:25.014ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48522
18502025-01-08T15:20:25.014ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48522 req_id = e960b3a7-1c7a-4053-8a0c-96fc3edde152 response_code = 200 uri = /baseboard
18512025-01-08T15:20:26.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39166
18522025-01-08T15:20:26.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39166 req_id = 1ec1bcea-95b0-4203-8bcd-6f4a36d7e214 response_code = 200 uri = /vpc-routes
18532025-01-08T15:20:26.952ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
18542025-01-08T15:20:26.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39166 req_id = d3406ec6-cb38-4ae7-bf01-56b7fb17ddbb response_code = 204 uri = /eip-gateways
18552025-01-08T15:20:26.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39166 req_id = eb4adf1b-f0ea-4d2d-83ec-475c2ca62c91 response_code = 204 uri = /vpc-routes
18562025-01-08T15:20:36.797ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:57921 remote_addr = [fd00:1122:3344:101::d]:53656 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
18572025-01-08T15:20:36.830ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30717 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 1c7f8ec7-67da-4b1c-8e32-935b6f608fc3 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
18582025-01-08T15:20:48.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55553
18592025-01-08T15:20:48.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55553 req_id = 202a0032-dca6-4039-b78b-d5b40722f321 response_code = 200 uri = /vpc-routes
18602025-01-08T15:20:48.966ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
18612025-01-08T15:20:48.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55553 req_id = 5435d7a2-b921-440c-b5d5-c3f91333ee99 response_code = 204 uri = /eip-gateways
18622025-01-08T15:20:48.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55553 req_id = a8a4ad80-97e1-4134-a86d-9583f31cc3b4 response_code = 204 uri = /vpc-routes
18632025-01-08T15:20:49.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53747
18642025-01-08T15:20:49.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53747 req_id = 9e244379-b5c6-4d2a-af51-4deb05ef0e97 response_code = 200 uri = /v2p
18652025-01-08T15:20:49.061ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56839
18662025-01-08T15:20:49.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56839 req_id = 6113e581-a246-460d-883c-df9059460f78 response_code = 200 uri = /v2p
18672025-01-08T15:20:49.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33215
18682025-01-08T15:20:49.126ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33215 req_id = c9aeb12a-e341-4203-a6a8-0b951f8fb9c8 response_code = 200 uri = /vpc-routes
18692025-01-08T15:20:49.176ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
18702025-01-08T15:20:49.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33215 req_id = 0ec28f53-0de6-4a1a-856a-ea66a5b90c66 response_code = 204 uri = /eip-gateways
18712025-01-08T15:20:49.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33215 req_id = 97473f8e-8296-479e-8fad-46ba7d21e23d response_code = 204 uri = /vpc-routes
18722025-01-08T15:20:49.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41647
18732025-01-08T15:20:49.214ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18742025-01-08T15:20:49.292ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18752025-01-08T15:20:49.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140701 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41647 req_id = 537cbcca-f986-4377-8cb6-c4e095f9ff66 response_code = 204 uri = /switch-ports
18762025-01-08T15:20:49.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61530
18772025-01-08T15:20:49.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55441
18782025-01-08T15:20:49.351ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18792025-01-08T15:20:49.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61530 req_id = 384b7adf-a5aa-4fd8-8e3d-2487b196a5f1 response_code = 200 uri = /vpc-routes
18802025-01-08T15:20:49.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5034 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41647 req_id = 19d36449-f7bc-478b-bd84-2451183f5494 response_code = 200 uri = /network-bootstore-config
18812025-01-08T15:20:49.371ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
18822025-01-08T15:20:49.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61530 req_id = 8b9c8361-4ce8-418d-be0f-2465d37b0d36 response_code = 204 uri = /eip-gateways
18832025-01-08T15:20:49.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61530 req_id = d9b7fc47-dc17-4083-bc43-b8c4881b097b response_code = 204 uri = /vpc-routes
18842025-01-08T15:20:49.390ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18852025-01-08T15:20:49.391ZINFOSledAgent (bootstore): Writing ledger to /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18862025-01-08T15:20:49.393ZINFOSledAgent (bootstore): Writing ledger to /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18872025-01-08T15:20:49.394ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18882025-01-08T15:20:49.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4825 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41647 req_id = 1783b6a9-51c5-4652-8c72-9290a34330c8 response_code = 204 uri = /network-bootstore-config
18892025-01-08T15:20:49.396ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18902025-01-08T15:20:49.438ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59632
18912025-01-08T15:20:49.438ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59632 req_id = a7108780-5e35-4523-aada-44f53d33729b response_code = 200 uri = /v2p
18922025-01-08T15:20:49.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113009 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55441 req_id = 78d85be2-b433-461a-aa36-827c4f0d739b response_code = 204 uri = /switch-ports
18932025-01-08T15:20:49.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55441 req_id = d3bba1fb-a61e-4706-bf3b-c23314220c04 response_code = 200 uri = /network-bootstore-config
18942025-01-08T15:20:49.560ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54876
18952025-01-08T15:20:49.561ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18962025-01-08T15:20:49.599ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18972025-01-08T15:20:49.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99188 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54876 req_id = 69d22006-5a33-4a48-b917-70ccf91cf012 response_code = 204 uri = /switch-ports
18982025-01-08T15:20:49.662ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54876 req_id = 735027c0-9638-46ec-8767-fb6db9c1eef4 response_code = 200 uri = /network-bootstore-config
18992025-01-08T15:20:55.048ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44153
19002025-01-08T15:20:55.049ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44153 req_id = d7b1f2b4-3dcb-4c35-a339-e5da119670b0 response_code = 200 uri = /baseboard
19012025-01-08T15:21:06.804ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7214 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 1705a22b-7ec5-4519-9df4-ba505462a907 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
19022025-01-08T15:21:18.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49451
19032025-01-08T15:21:18.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49451 req_id = 7ac449c8-79ba-45d2-9643-7a4fb128f3dd response_code = 200 uri = /vpc-routes
19042025-01-08T15:21:18.810ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
19052025-01-08T15:21:18.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49451 req_id = d6863455-8f68-4393-9f21-08997a497cbd response_code = 204 uri = /eip-gateways
19062025-01-08T15:21:18.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49451 req_id = d70f39ba-402c-40ac-a76c-e8027fe767c8 response_code = 204 uri = /vpc-routes
19072025-01-08T15:21:18.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51633
19082025-01-08T15:21:18.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51633 req_id = 33c17272-db2a-4d43-bd65-1af629fa0ffc response_code = 200 uri = /vpc-routes
19092025-01-08T15:21:18.892ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
19102025-01-08T15:21:18.892ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51633 req_id = b6984b39-0936-4da7-afc5-699c3f1edf59 response_code = 204 uri = /eip-gateways
19112025-01-08T15:21:18.933ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42547
19122025-01-08T15:21:18.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42547 req_id = 81c01214-afa3-44fd-98c8-6ecbb4058b75 response_code = 200 uri = /v2p
19132025-01-08T15:21:18.946ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42910
19142025-01-08T15:21:18.946ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19152025-01-08T15:21:18.997ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19162025-01-08T15:21:19.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42910 req_id = 08d47d22-d1ea-4bca-8b99-5ccac92a0689 response_code = 204 uri = /switch-ports
19172025-01-08T15:21:19.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47526
19182025-01-08T15:21:19.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47526 req_id = d42c5e3e-0c58-488c-934f-72331f16ca74 response_code = 200 uri = /v2p
19192025-01-08T15:21:19.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 472 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51633 req_id = bfcd2b5c-3498-4970-8d2c-1a696ebaad35 response_code = 204 uri = /vpc-routes
19202025-01-08T15:21:19.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 351 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42910 req_id = c9185056-1a71-4c15-9f5a-6dcbb78dc8db response_code = 200 uri = /network-bootstore-config
19212025-01-08T15:21:19.071ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52647
19222025-01-08T15:21:19.071ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19232025-01-08T15:21:19.108ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19242025-01-08T15:21:19.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95637 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52647 req_id = 3ade3a70-f5f4-4705-aa5e-a177dd23bc39 response_code = 204 uri = /switch-ports
19252025-01-08T15:21:19.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57356
19262025-01-08T15:21:19.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57356 req_id = eb25e08f-495c-455e-a7de-a5249c2e6208 response_code = 200 uri = /vpc-routes
19272025-01-08T15:21:19.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52647 req_id = 3fc71006-7415-410c-9420-70896a102e54 response_code = 200 uri = /network-bootstore-config
19282025-01-08T15:21:19.211ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
19292025-01-08T15:21:19.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57356 req_id = 66739688-3af2-4e73-ab29-35c5014e7c4a response_code = 204 uri = /eip-gateways
19302025-01-08T15:21:19.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65019
19312025-01-08T15:21:19.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65019 req_id = 8ddadbb0-8e73-43dd-b94f-503fb24aedcf response_code = 200 uri = /v2p
19322025-01-08T15:21:19.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57356 req_id = bc21eb0b-2d2a-496a-8432-6538f102bec7 response_code = 204 uri = /vpc-routes
19332025-01-08T15:21:19.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53428
19342025-01-08T15:21:19.261ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19352025-01-08T15:21:19.295ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19362025-01-08T15:21:19.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53428 req_id = 894fb162-fff7-4acb-aa20-d8ac11ad064c response_code = 204 uri = /switch-ports
19372025-01-08T15:21:19.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53428 req_id = 84946406-ffed-4533-903c-85596ed74daa response_code = 200 uri = /network-bootstore-config
19382025-01-08T15:21:25.080ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59462
19392025-01-08T15:21:25.080ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59462 req_id = b5e0161f-d736-4037-a07d-9cee2c17cdec response_code = 200 uri = /baseboard
19402025-01-08T15:21:36.805ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9072 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 8bf820f0-5452-45de-9f94-374f5c5a80c1 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
19412025-01-08T15:21:49.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45620
19422025-01-08T15:21:49.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45620 req_id = 452ed2d0-a9dd-4c29-b4b1-e0de0b3c5a88 response_code = 200 uri = /vpc-routes
19432025-01-08T15:21:49.163ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
19442025-01-08T15:21:49.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45620 req_id = c060ef14-9ea0-47c3-a272-e635b4592758 response_code = 204 uri = /eip-gateways
19452025-01-08T15:21:49.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35547
19462025-01-08T15:21:49.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35547 req_id = cd82301c-599a-486a-a255-2e0d4f195d52 response_code = 200 uri = /vpc-routes
19472025-01-08T15:21:49.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48603
19482025-01-08T15:21:49.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48603 req_id = a2826f82-5af7-4d2a-ad12-3cd3e1f48e37 response_code = 200 uri = /v2p
19492025-01-08T15:21:49.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43227
19502025-01-08T15:21:49.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43227 req_id = c8c2c753-62d4-4227-9abd-9363d857ecfe response_code = 200 uri = /v2p
19512025-01-08T15:21:49.191ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62213
19522025-01-08T15:21:49.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62213 req_id = e7f6ebbf-14af-4a27-aaff-371ebb8a094a response_code = 200 uri = /vpc-routes
19532025-01-08T15:21:49.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45620 req_id = 294f60d3-f0d5-4314-8c47-63f3ae141594 response_code = 204 uri = /vpc-routes
19542025-01-08T15:21:49.243ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
19552025-01-08T15:21:49.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35547 req_id = 707372ff-d303-4270-b5ad-61671e5dafcb response_code = 204 uri = /eip-gateways
19562025-01-08T15:21:49.258ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
19572025-01-08T15:21:49.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62213 req_id = f9996c0e-dc6c-4f7a-9979-dc34b6a4084d response_code = 204 uri = /eip-gateways
19582025-01-08T15:21:49.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35547 req_id = 65a42af2-763e-4146-965d-033c2567058b response_code = 204 uri = /vpc-routes
19592025-01-08T15:21:49.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62213 req_id = 25f01d61-4c5a-4259-b18e-ded02f5cc56b response_code = 204 uri = /vpc-routes
19602025-01-08T15:21:49.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50568
19612025-01-08T15:21:49.308ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19622025-01-08T15:21:49.345ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19632025-01-08T15:21:49.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95149 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50568 req_id = 4331eaf1-7267-41d1-b7a5-5ee4d70bc9de response_code = 204 uri = /switch-ports
19642025-01-08T15:21:49.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46099
19652025-01-08T15:21:49.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54225
19662025-01-08T15:21:49.404ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19672025-01-08T15:21:49.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3547 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50568 req_id = 005b5201-529a-40d1-83bf-277f2f995981 response_code = 200 uri = /network-bootstore-config
19682025-01-08T15:21:49.438ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19692025-01-08T15:21:49.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61367
19702025-01-08T15:21:49.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61367 req_id = d9197681-071a-4b03-8646-465a0cae9e62 response_code = 200 uri = /v2p
19712025-01-08T15:21:49.489ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19722025-01-08T15:21:49.489ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85458 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54225 req_id = 189c2522-d432-4f25-a381-3e68ab3d69a8 response_code = 204 uri = /switch-ports
19732025-01-08T15:21:49.493ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 689 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54225 req_id = f6512753-4d3b-4ab6-ad26-d21e7844d990 response_code = 200 uri = /network-bootstore-config
19742025-01-08T15:21:49.524ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19752025-01-08T15:21:49.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172816 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46099 req_id = ac24c6c3-4e0a-406d-81dd-8f0abf31782c response_code = 204 uri = /switch-ports
19762025-01-08T15:21:49.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46099 req_id = d8300866-9e16-4e77-b7f5-5e01498f9667 response_code = 200 uri = /network-bootstore-config
19772025-01-08T15:21:55.121ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54727
19782025-01-08T15:21:55.121ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54727 req_id = c25bbab6-ca08-4adb-b849-aa0481f18f5c response_code = 200 uri = /baseboard
19792025-01-08T15:22:06.806ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7221 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = c3a4f9d1-3eb3-42a7-8297-1ac0b44f2966 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
19802025-01-08T15:22:18.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40624
19812025-01-08T15:22:18.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40624 req_id = 1d0c3ce3-89be-42d3-882f-d756c4e01133 response_code = 200 uri = /vpc-routes
19822025-01-08T15:22:18.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
19832025-01-08T15:22:18.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40624 req_id = 1a1a61eb-9685-495a-b961-271d10428b06 response_code = 204 uri = /eip-gateways
19842025-01-08T15:22:18.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:40624 req_id = 93936f06-c20f-4705-aae2-90a444c57f7f response_code = 204 uri = /vpc-routes
19852025-01-08T15:22:18.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55596
19862025-01-08T15:22:18.917ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19872025-01-08T15:22:18.965ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19882025-01-08T15:22:19.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116260 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55596 req_id = df5e4997-58d8-43c0-985a-175facc867c3 response_code = 204 uri = /switch-ports
19892025-01-08T15:22:19.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60898
19902025-01-08T15:22:19.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38767
19912025-01-08T15:22:19.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42592
19922025-01-08T15:22:19.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60898 req_id = 13e0a08c-8814-4303-9cd2-48e66ca9fa43 response_code = 200 uri = /vpc-routes
19932025-01-08T15:22:19.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55596 req_id = 5e99b7b9-c4d8-468e-a5c3-23b586312951 response_code = 200 uri = /network-bootstore-config
19942025-01-08T15:22:19.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42592 req_id = 4d1e61c3-b01a-4675-bfb9-2aefda7408f5 response_code = 200 uri = /v2p
19952025-01-08T15:22:19.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38767 req_id = 57ef5da9-3ed8-4460-bd27-90c1b4ce9acc response_code = 200 uri = /v2p
19962025-01-08T15:22:19.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
19972025-01-08T15:22:19.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60898 req_id = f480bddf-2979-4eb5-a85f-90d3a47aa497 response_code = 204 uri = /eip-gateways
19982025-01-08T15:22:19.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34828
19992025-01-08T15:22:19.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34828 req_id = 28c7e963-8f12-4cf2-9b82-10254f9387b4 response_code = 200 uri = /vpc-routes
20002025-01-08T15:22:19.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60898 req_id = b203b07e-a951-4472-a70f-2e28453f2696 response_code = 204 uri = /vpc-routes
20012025-01-08T15:22:19.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62611
20022025-01-08T15:22:19.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20032025-01-08T15:22:19.121ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20042025-01-08T15:22:19.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94403 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62611 req_id = 95d28a45-99a0-4d56-a3d8-3b125b5226fd response_code = 204 uri = /switch-ports
20052025-01-08T15:22:19.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64263
20062025-01-08T15:22:19.178ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
20072025-01-08T15:22:19.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34828 req_id = cb52ab4d-f4bd-442a-b424-6baebfd7086e response_code = 204 uri = /eip-gateways
20082025-01-08T15:22:19.178ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20092025-01-08T15:22:19.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62611 req_id = ced4c8fb-a2c8-4c5f-b8d6-5f4c9b46989d response_code = 200 uri = /network-bootstore-config
20102025-01-08T15:22:19.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34828 req_id = 9ef6ddbe-e5c4-4b21-a19d-004d7e74a3c9 response_code = 204 uri = /vpc-routes
20112025-01-08T15:22:19.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33981
20122025-01-08T15:22:19.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33981 req_id = a04bb30a-af71-4d1f-a0b9-5b6913e04eb7 response_code = 200 uri = /v2p
20132025-01-08T15:22:19.214ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20142025-01-08T15:22:19.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91808 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64263 req_id = 2c2328b7-3d0a-401b-a58d-7f4407c904eb response_code = 204 uri = /switch-ports
20152025-01-08T15:22:19.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64263 req_id = b820ea3e-1edb-45fc-b0f8-663d02057a05 response_code = 200 uri = /network-bootstore-config
20162025-01-08T15:22:25.158ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57863
20172025-01-08T15:22:25.158ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57863 req_id = 7b504c2a-99ed-4b69-93a5-b097a12e1c3a response_code = 200 uri = /baseboard
20182025-01-08T15:22:36.807ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8944 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 2a4d0680-3f5f-4d98-9294-ec250bbe0065 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
20192025-01-08T15:22:46.128ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20202025-01-08T15:22:48.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36885
20212025-01-08T15:22:48.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36885 req_id = 1f07e5b5-dfa6-463c-8f56-e7f209142917 response_code = 200 uri = /vpc-routes
20222025-01-08T15:22:49.038ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
20232025-01-08T15:22:49.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36885 req_id = 9d5001ba-e4dc-4b49-a792-5a562c8b04ef response_code = 204 uri = /eip-gateways
20242025-01-08T15:22:49.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33324
20252025-01-08T15:22:49.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33324 req_id = e708146d-c8df-4b3d-a498-d339e1594e49 response_code = 200 uri = /v2p
20262025-01-08T15:22:49.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36885 req_id = 9edf67c6-a339-4f9d-9b8e-29245de39e15 response_code = 204 uri = /vpc-routes
20272025-01-08T15:22:49.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54232
20282025-01-08T15:22:49.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54232 req_id = 68d418bb-d23d-4e0a-ac3c-507399a50040 response_code = 200 uri = /vpc-routes
20292025-01-08T15:22:49.119ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
20302025-01-08T15:22:49.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54232 req_id = 31cfa485-6220-441e-97ad-61a3328e88bb response_code = 204 uri = /eip-gateways
20312025-01-08T15:22:49.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54232 req_id = 742c83d8-cb88-4894-b2d6-36631c3b96c2 response_code = 204 uri = /vpc-routes
20322025-01-08T15:22:49.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49398
20332025-01-08T15:22:49.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49398 req_id = 665305e5-c831-47c1-8195-e1b490a2539c response_code = 200 uri = /vpc-routes
20342025-01-08T15:22:49.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41215
20352025-01-08T15:22:49.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41215 req_id = 7919e2f8-cced-4c39-88cd-c3b7687473de response_code = 200 uri = /v2p
20362025-01-08T15:22:49.237ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
20372025-01-08T15:22:49.237ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49398 req_id = 2af3ae03-8cfc-495a-be1a-14426f3a0c39 response_code = 204 uri = /eip-gateways
20382025-01-08T15:22:49.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58630
20392025-01-08T15:22:49.243ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20402025-01-08T15:22:49.283ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20412025-01-08T15:22:49.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97149 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58630 req_id = cbebf593-c2c2-4f48-98ab-d46f14d53b38 response_code = 204 uri = /switch-ports
20422025-01-08T15:22:49.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51916
20432025-01-08T15:22:49.340ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20442025-01-08T15:22:49.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5375 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58630 req_id = d203fd2f-8878-4a28-b84e-8004944442f0 response_code = 200 uri = /network-bootstore-config
20452025-01-08T15:22:49.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5491 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49398 req_id = 248735fd-84a0-4d82-8058-99f253df60b7 response_code = 204 uri = /vpc-routes
20462025-01-08T15:22:49.378ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20472025-01-08T15:22:49.433ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92866 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51916 req_id = cf7e6cac-1de0-4990-a0d0-55d1ff965f49 response_code = 204 uri = /switch-ports
20482025-01-08T15:22:49.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51916 req_id = 596931c6-c442-4f49-9195-4bbb3845a8ef response_code = 200 uri = /network-bootstore-config
20492025-01-08T15:22:49.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63162
20502025-01-08T15:22:49.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63162 req_id = 3f8f3bc8-4c99-446c-892b-18cf989cead1 response_code = 200 uri = /v2p
20512025-01-08T15:22:49.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59364
20522025-01-08T15:22:49.671ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20532025-01-08T15:22:49.708ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20542025-01-08T15:22:49.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91569 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59364 req_id = 7bc07f8c-e4d0-4aeb-8c1b-fafdb95434b3 response_code = 204 uri = /switch-ports
20552025-01-08T15:22:49.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59364 req_id = bd08af4d-a7b7-40aa-b60c-91a4891341d8 response_code = 200 uri = /network-bootstore-config
20562025-01-08T15:22:55.191ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63783
20572025-01-08T15:22:55.191ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63783 req_id = f5605f0f-afea-471c-9c18-e8dadf851f1e response_code = 200 uri = /baseboard
20582025-01-08T15:23:06.806ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6890 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 753ca03d-67d3-455e-80eb-2f489a875bc5 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
20592025-01-08T15:23:18.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61724
20602025-01-08T15:23:18.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61724 req_id = 407d0f9c-fbae-4edf-9a67-9bfa8e824a62 response_code = 200 uri = /vpc-routes
20612025-01-08T15:23:18.924ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
20622025-01-08T15:23:18.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61724 req_id = b4b05ac4-2986-44d1-a618-c13895d84084 response_code = 204 uri = /eip-gateways
20632025-01-08T15:23:18.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44694
20642025-01-08T15:23:18.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44694 req_id = c4a88788-505b-4e4b-b0af-34cc7b68f291 response_code = 200 uri = /vpc-routes
20652025-01-08T15:23:18.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61724 req_id = d8c90a83-da46-48a1-908c-6afd04e55ebc response_code = 204 uri = /vpc-routes
20662025-01-08T15:23:18.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33084
20672025-01-08T15:23:18.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33084 req_id = 2625ed46-0ee1-4a64-ac54-10716bed7a3a response_code = 200 uri = /v2p
20682025-01-08T15:23:18.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48219
20692025-01-08T15:23:18.986ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20702025-01-08T15:23:19.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20712025-01-08T15:23:19.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114820 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48219 req_id = 0cfa9a28-82ed-4a23-851f-2b310ad2428c response_code = 204 uri = /switch-ports
20722025-01-08T15:23:19.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41584
20732025-01-08T15:23:19.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
20742025-01-08T15:23:19.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44694 req_id = 4841e951-768c-4d44-82f1-c2412088821f response_code = 204 uri = /eip-gateways
20752025-01-08T15:23:19.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45883
20762025-01-08T15:23:19.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35185
20772025-01-08T15:23:19.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41584 req_id = 26688c75-0f36-4172-abe8-f07f1deee108 response_code = 200 uri = /vpc-routes
20782025-01-08T15:23:19.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48219 req_id = 9a2edbba-fe6e-46e7-b776-f1c91e368b2a response_code = 200 uri = /network-bootstore-config
20792025-01-08T15:23:19.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35185 req_id = 13cf4bbe-c83a-4fc2-b2a5-222202b010e0 response_code = 200 uri = /v2p
20802025-01-08T15:23:19.102ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20812025-01-08T15:23:19.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 359 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44694 req_id = 54c2d28b-842e-45d1-ab69-84423128ab55 response_code = 204 uri = /vpc-routes
20822025-01-08T15:23:19.122ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
20832025-01-08T15:23:19.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 579 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41584 req_id = 6c875edf-7ca9-498f-9dbc-16f2533f49e9 response_code = 204 uri = /eip-gateways
20842025-01-08T15:23:19.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 932 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41584 req_id = 0ae99002-7dc2-43e3-a461-ff1b4b588916 response_code = 204 uri = /vpc-routes
20852025-01-08T15:23:19.144ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20862025-01-08T15:23:19.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45883 req_id = 1ddfb6a4-1600-4bff-bd46-acca24d38ac2 response_code = 204 uri = /switch-ports
20872025-01-08T15:23:19.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45883 req_id = 84ec310f-2a0b-4c32-ba29-c62bd529fa2f response_code = 200 uri = /network-bootstore-config
20882025-01-08T15:23:19.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37586
20892025-01-08T15:23:19.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37586 req_id = bbc81584-bd3a-4e46-a85c-7d191d22243b response_code = 200 uri = /v2p
20902025-01-08T15:23:19.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42739
20912025-01-08T15:23:19.363ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20922025-01-08T15:23:19.400ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20932025-01-08T15:23:19.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91849 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42739 req_id = 9295db8b-aad3-4ab9-83e8-7422b9178b51 response_code = 204 uri = /switch-ports
20942025-01-08T15:23:19.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42739 req_id = e6204de4-03d5-4108-87ae-b2ca84786c8e response_code = 200 uri = /network-bootstore-config
20952025-01-08T15:23:25.225ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60119
20962025-01-08T15:23:25.225ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60119 req_id = 9bb799b0-ccf0-4ee0-80b5-c0a37ca0e5ed response_code = 200 uri = /baseboard
20972025-01-08T15:23:36.809ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10323 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 4de9acd0-286f-431b-abfa-6ae086410fc2 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
20982025-01-08T15:23:48.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38731
20992025-01-08T15:23:48.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38731 req_id = 1f8a0e5a-266f-4f12-a896-72df8537848d response_code = 200 uri = /vpc-routes
21002025-01-08T15:23:49.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
21012025-01-08T15:23:49.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38731 req_id = e88c208d-e7a6-4db6-bce7-adb31c27e6f9 response_code = 204 uri = /eip-gateways
21022025-01-08T15:23:49.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38731 req_id = d5287a1b-5df6-452c-82e2-384abdad6e84 response_code = 204 uri = /vpc-routes
21032025-01-08T15:23:49.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46249
21042025-01-08T15:23:49.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46249 req_id = 8bbf7180-4b2d-41cf-a29d-451867051455 response_code = 200 uri = /vpc-routes
21052025-01-08T15:23:49.161ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37016
21062025-01-08T15:23:49.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37016 req_id = cb245b64-fe1d-4b8b-b129-a3cd8ca34c04 response_code = 200 uri = /v2p
21072025-01-08T15:23:49.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
21082025-01-08T15:23:49.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46249 req_id = a9048636-5071-43cb-bcd9-9eb578f9169e response_code = 204 uri = /eip-gateways
21092025-01-08T15:23:49.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47407
21102025-01-08T15:23:49.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47407 req_id = ca067de4-f74e-4870-b871-6acf8cd55b25 response_code = 200 uri = /v2p
21112025-01-08T15:23:49.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46249 req_id = 08e5444c-25fd-445a-8411-7a69debe1bb5 response_code = 204 uri = /vpc-routes
21122025-01-08T15:23:49.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57831
21132025-01-08T15:23:49.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57831 req_id = fddbc8e7-b634-4bc3-a888-388ba9d0c8c0 response_code = 200 uri = /vpc-routes
21142025-01-08T15:23:49.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65488
21152025-01-08T15:23:49.247ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21162025-01-08T15:23:49.289ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21172025-01-08T15:23:49.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102876 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65488 req_id = fc96e091-ad89-4160-b94a-48b608e9d5f6 response_code = 204 uri = /switch-ports
21182025-01-08T15:23:49.350ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47808
21192025-01-08T15:23:49.350ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
21202025-01-08T15:23:49.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57831 req_id = 8c1a5d86-be74-4cc2-8340-0a595f911848 response_code = 204 uri = /eip-gateways
21212025-01-08T15:23:49.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65488 req_id = 580d1eaf-602b-4c61-a6da-81b966b0c4dd response_code = 200 uri = /network-bootstore-config
21222025-01-08T15:23:49.351ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21232025-01-08T15:23:49.389ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21242025-01-08T15:23:49.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93346 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47808 req_id = 2eb3e18f-9472-4a26-abc1-d2904908f0ae response_code = 204 uri = /switch-ports
21252025-01-08T15:23:49.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47808 req_id = e53e1a15-4635-4081-9c2d-b5614fb2c181 response_code = 200 uri = /network-bootstore-config
21262025-01-08T15:23:49.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52501
21272025-01-08T15:23:49.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52501 req_id = 32c6afff-0bd8-4c56-8fac-6df616c316b8 response_code = 200 uri = /v2p
21282025-01-08T15:23:49.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57831 req_id = 30a10722-28fe-4877-a96d-b55b4b064bba response_code = 204 uri = /vpc-routes
21292025-01-08T15:23:49.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37746
21302025-01-08T15:23:49.567ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21312025-01-08T15:23:49.605ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21322025-01-08T15:23:49.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95564 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37746 req_id = 9d05700c-0312-4a58-820c-7b7a5a1b0123 response_code = 204 uri = /switch-ports
21332025-01-08T15:23:49.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37746 req_id = 196034e4-6009-45ba-beee-a1a4b75f009a response_code = 200 uri = /network-bootstore-config
21342025-01-08T15:23:55.259ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62323
21352025-01-08T15:23:55.260ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62323 req_id = 6bf44d1c-dbfa-4218-b1ce-b46e72964b6d response_code = 200 uri = /baseboard
21362025-01-08T15:24:06.808ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8947 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = cd23cf6b-4f35-4f06-8848-739ddeb6ebaf response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
21372025-01-08T15:24:18.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48086
21382025-01-08T15:24:18.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48086 req_id = 105f34bb-c12e-4f4f-8cdc-9a2b273b4ac0 response_code = 200 uri = /vpc-routes
21392025-01-08T15:24:18.786ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
21402025-01-08T15:24:18.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48086 req_id = 478f0d04-1d9c-4572-a5ea-d08dc7c3138d response_code = 204 uri = /eip-gateways
21412025-01-08T15:24:18.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48086 req_id = 4fbb5a9a-2e7d-4605-b7c6-509e38fc0526 response_code = 204 uri = /vpc-routes
21422025-01-08T15:24:18.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47167
21432025-01-08T15:24:18.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47167 req_id = 776c8bec-4429-4470-a575-3fb227b1aa5a response_code = 200 uri = /vpc-routes
21442025-01-08T15:24:18.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54756
21452025-01-08T15:24:18.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54756 req_id = 3511c497-5678-4aaa-b125-58a4197b4cac response_code = 200 uri = /v2p
21462025-01-08T15:24:18.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54164
21472025-01-08T15:24:18.925ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21482025-01-08T15:24:18.979ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21492025-01-08T15:24:19.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130325 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54164 req_id = 703d2a94-a0d6-4a52-a538-83d010d93011 response_code = 204 uri = /switch-ports
21502025-01-08T15:24:19.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39867
21512025-01-08T15:24:19.056ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
21522025-01-08T15:24:19.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47167 req_id = 226e6c0a-e0ca-4445-808c-8f222c25bdcd response_code = 204 uri = /eip-gateways
21532025-01-08T15:24:19.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59302
21542025-01-08T15:24:19.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65088
21552025-01-08T15:24:19.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54164 req_id = d125286a-e6e4-4671-8b00-7057e2565712 response_code = 200 uri = /network-bootstore-config
21562025-01-08T15:24:19.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39867 req_id = e84d9b31-2d19-4bcd-9018-bdfb7efaaee3 response_code = 200 uri = /v2p
21572025-01-08T15:24:19.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59302 req_id = 8e28271c-b748-4155-bab6-1a0a5b8092df response_code = 200 uri = /vpc-routes
21582025-01-08T15:24:19.056ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21592025-01-08T15:24:19.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 479 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47167 req_id = 0728798d-52c2-46f4-b26f-39383c7e710a response_code = 204 uri = /vpc-routes
21602025-01-08T15:24:19.101ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21612025-01-08T15:24:19.105ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
21622025-01-08T15:24:19.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 790 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59302 req_id = 0e880ab8-e0d1-4ff1-aa0e-59c8d7814c90 response_code = 204 uri = /eip-gateways
21632025-01-08T15:24:19.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 757 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59302 req_id = 42348159-0449-49a3-9187-76785ea2ef4d response_code = 204 uri = /vpc-routes
21642025-01-08T15:24:19.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55431
21652025-01-08T15:24:19.165ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21662025-01-08T15:24:19.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109074 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65088 req_id = 4dbd9180-8265-483b-888b-bfc87841adb1 response_code = 204 uri = /switch-ports
21672025-01-08T15:24:19.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 771 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65088 req_id = 4201a84b-480d-4335-ac7a-4e7aecd68201 response_code = 200 uri = /network-bootstore-config
21682025-01-08T15:24:19.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39039
21692025-01-08T15:24:19.204ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21702025-01-08T15:24:19.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3394 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39039 req_id = 9e6bdc7b-1c6c-49cb-9236-a630fbb0cf37 response_code = 200 uri = /v2p
21712025-01-08T15:24:19.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133886 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55431 req_id = 82bc7110-2c04-4866-937d-be009449a66f response_code = 204 uri = /switch-ports
21722025-01-08T15:24:19.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55431 req_id = c32c8154-6d38-4301-a3bd-62d14dbbe65f response_code = 200 uri = /network-bootstore-config
21732025-01-08T15:24:25.295ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64464
21742025-01-08T15:24:25.295ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64464 req_id = 095bcb7a-e0aa-43b6-a24b-e51a4b5bd8e4 response_code = 200 uri = /baseboard
21752025-01-08T15:24:36.806ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7147 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 5d8ea613-1c7f-4a94-b69f-1f50a3e02b03 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
21762025-01-08T15:24:48.830ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58279
21772025-01-08T15:24:48.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 602 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58279 req_id = 61532606-e3c5-4e31-81d6-1a85d0370156 response_code = 200 uri = /vpc-routes
21782025-01-08T15:24:48.936ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
21792025-01-08T15:24:48.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58279 req_id = eae6df75-8eb0-4b18-ba4c-549848bfea23 response_code = 204 uri = /eip-gateways
21802025-01-08T15:24:48.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58279 req_id = 48c914e6-d176-4063-a8c0-a6c632897ff3 response_code = 204 uri = /vpc-routes
21812025-01-08T15:24:49.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41960
21822025-01-08T15:24:49.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41960 req_id = edb9bec3-a54b-453b-b7d8-513c726f70bd response_code = 200 uri = /v2p
21832025-01-08T15:24:49.131ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53638
21842025-01-08T15:24:49.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53638 req_id = 4a692ff7-2bda-46c3-b7e2-0c6ab8646905 response_code = 200 uri = /vpc-routes
21852025-01-08T15:24:49.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49621
21862025-01-08T15:24:49.137ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21872025-01-08T15:24:49.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21882025-01-08T15:24:49.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97901 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49621 req_id = 0257d39b-3be5-40b4-84dd-a16c0f034f73 response_code = 204 uri = /switch-ports
21892025-01-08T15:24:49.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49621 req_id = 533005e4-6669-4f65-a502-36bfd6709295 response_code = 200 uri = /network-bootstore-config
21902025-01-08T15:24:49.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52658
21912025-01-08T15:24:49.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52658 req_id = 0a61bee2-91c9-4a8b-8524-b9f89898da3a response_code = 200 uri = /vpc-routes
21922025-01-08T15:24:49.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47002
21932025-01-08T15:24:49.270ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21942025-01-08T15:24:49.270ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21952025-01-08T15:24:49.270ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21962025-01-08T15:24:49.270ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21972025-01-08T15:24:49.271ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21982025-01-08T15:24:49.271ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21992025-01-08T15:24:49.271ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22002025-01-08T15:24:49.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 513 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47002 req_id = dcc60866-aada-4f6d-90de-174ca07b2cfc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22012025-01-08T15:24:49.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37402
22022025-01-08T15:24:49.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37402 req_id = f3790f67-7ea9-455c-b114-95651f377639 response_code = 200 uri = /v2p
22032025-01-08T15:24:49.301ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
22042025-01-08T15:24:49.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52658 req_id = 3a1bdfda-6425-48f8-9235-a0bd0887ac4a response_code = 204 uri = /eip-gateways
22052025-01-08T15:24:49.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52658 req_id = 04954949-227e-485d-845c-3130a579eba8 response_code = 204 uri = /vpc-routes
22062025-01-08T15:24:49.311ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
22072025-01-08T15:24:49.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53638 req_id = 2caa52d8-f3f6-4c7c-a171-14cdbe0b6644 response_code = 204 uri = /eip-gateways
22082025-01-08T15:24:49.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53638 req_id = 16b67bb3-d9ef-439a-9a6d-df580c34e2bc response_code = 204 uri = /vpc-routes
22092025-01-08T15:24:49.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42280
22102025-01-08T15:24:49.388ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22112025-01-08T15:24:49.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22122025-01-08T15:24:49.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22132025-01-08T15:24:49.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22142025-01-08T15:24:49.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22152025-01-08T15:24:49.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22162025-01-08T15:24:49.388ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22172025-01-08T15:24:49.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42280 req_id = 25c5edfc-f931-489c-aa53-9336a722d106 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22182025-01-08T15:24:49.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35669
22192025-01-08T15:24:49.400ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22202025-01-08T15:24:49.441ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22212025-01-08T15:24:49.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35669 req_id = ad33d387-82eb-42e0-8507-9f4f293bb27f response_code = 204 uri = /switch-ports
22222025-01-08T15:24:49.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38190
22232025-01-08T15:24:49.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41877
22242025-01-08T15:24:49.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38190 req_id = be9495e2-df0b-4309-aaf7-cc994fd2f596 response_code = 200 uri = /v2p
22252025-01-08T15:24:49.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35669 req_id = 2b9e636b-399e-4484-83dd-7fa21bcc72c1 response_code = 200 uri = /network-bootstore-config
22262025-01-08T15:24:49.504ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22272025-01-08T15:24:49.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22282025-01-08T15:24:49.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32859
22292025-01-08T15:24:49.546ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22302025-01-08T15:24:49.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22312025-01-08T15:24:49.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22322025-01-08T15:24:49.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22332025-01-08T15:24:49.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22342025-01-08T15:24:49.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22352025-01-08T15:24:49.547ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22362025-01-08T15:24:49.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 432 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:32859 req_id = 0754616e-4200-407b-b7e7-5bd6e3634ce5 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22372025-01-08T15:24:49.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94120 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:41877 req_id = 636348fa-4b18-4e11-8fa6-de0b30d57d22 response_code = 204 uri = /switch-ports
22382025-01-08T15:24:49.598ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41877 req_id = 049d4c3f-9a01-488f-bac3-123ce4d23348 response_code = 200 uri = /network-bootstore-config
22392025-01-08T15:24:55.328ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60933
22402025-01-08T15:24:55.329ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60933 req_id = c3a073b0-b3f5-4488-a26d-7000c8aecb4b response_code = 200 uri = /baseboard
22412025-01-08T15:25:06.807ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7915 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 62cae152-8b1e-4e1a-9ede-d20320c6505c response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
22422025-01-08T15:25:18.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49080
22432025-01-08T15:25:18.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49080 req_id = c4878faa-bebe-4a15-8ef2-654d053f268b response_code = 200 uri = /vpc-routes
22442025-01-08T15:25:18.804ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
22452025-01-08T15:25:18.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49080 req_id = 0b1df7cd-1e98-40d9-89b4-095c5c695f65 response_code = 204 uri = /eip-gateways
22462025-01-08T15:25:18.813ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49080 req_id = 33ed7104-6581-4722-a227-eacc8607a21c response_code = 204 uri = /vpc-routes
22472025-01-08T15:25:18.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51282
22482025-01-08T15:25:18.944ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22492025-01-08T15:25:18.987ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22502025-01-08T15:25:19.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107274 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51282 req_id = 6b599468-a881-4801-8b30-2d89b2af740f response_code = 204 uri = /switch-ports
22512025-01-08T15:25:19.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50531
22522025-01-08T15:25:19.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58723
22532025-01-08T15:25:19.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51282 req_id = 925c271c-8565-4e65-b083-0c47ab25c7c0 response_code = 200 uri = /network-bootstore-config
22542025-01-08T15:25:19.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50531 req_id = 4b783751-8fe6-4b5d-839c-15bf1b51d426 response_code = 200 uri = /vpc-routes
22552025-01-08T15:25:19.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58723 req_id = 894002bf-24ae-4b16-b9e0-87687c032f26 response_code = 200 uri = /v2p
22562025-01-08T15:25:19.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47654
22572025-01-08T15:25:19.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47654 req_id = 24a61d14-2e25-46b6-bbbf-9b6cbd7c7081 response_code = 200 uri = /vpc-routes
22582025-01-08T15:25:19.107ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
22592025-01-08T15:25:19.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50531 req_id = 8813807b-ad4c-48f3-8b9a-12822c8398d2 response_code = 204 uri = /eip-gateways
22602025-01-08T15:25:19.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
22612025-01-08T15:25:19.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47654 req_id = 22a9072a-5127-4a8f-a18c-1f158938d987 response_code = 204 uri = /eip-gateways
22622025-01-08T15:25:19.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47654 req_id = 7056ba60-5622-4d27-9b6d-1eed1206609a response_code = 204 uri = /vpc-routes
22632025-01-08T15:25:19.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38773
22642025-01-08T15:25:19.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38773 req_id = a27f2f12-9b43-46f8-b8e7-840febde7ace response_code = 200 uri = /v2p
22652025-01-08T15:25:19.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50531 req_id = b2c74090-c57b-4c5a-bd05-aa86bb97f306 response_code = 204 uri = /vpc-routes
22662025-01-08T15:25:19.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34284
22672025-01-08T15:25:19.155ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22682025-01-08T15:25:19.195ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22692025-01-08T15:25:19.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96488 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34284 req_id = 252d7140-7bc3-40ba-90d4-d59f889ffc59 response_code = 204 uri = /switch-ports
22702025-01-08T15:25:19.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34781
22712025-01-08T15:25:19.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54954
22722025-01-08T15:25:19.252ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22732025-01-08T15:25:19.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3897 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34284 req_id = 0fab49cc-8063-48a9-90cb-15a0e853085d response_code = 200 uri = /network-bootstore-config
22742025-01-08T15:25:19.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3850 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34781 req_id = f8d7259a-e2cf-4664-a662-ca704369525c response_code = 200 uri = /v2p
22752025-01-08T15:25:19.288ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22762025-01-08T15:25:19.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90495 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54954 req_id = b96c49e0-d14e-41e4-b401-0ebc8f9b0688 response_code = 204 uri = /switch-ports
22772025-01-08T15:25:19.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54954 req_id = adf83be5-3ca5-462c-8ed6-20d5bc753b8f response_code = 200 uri = /network-bootstore-config
22782025-01-08T15:25:25.362ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48696
22792025-01-08T15:25:25.362ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48696 req_id = 54e873ef-f0f5-4e9c-b20b-86871b8ddb02 response_code = 200 uri = /baseboard
22802025-01-08T15:25:36.807ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7433 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = d5d94e61-b3b8-4ef9-bb96-73c2d2a97ec9 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
22812025-01-08T15:25:49.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39449
22822025-01-08T15:25:49.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39449 req_id = 23eea754-4490-46da-9e8b-8dedc08ad511 response_code = 200 uri = /vpc-routes
22832025-01-08T15:25:49.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46040
22842025-01-08T15:25:49.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46040 req_id = ab1d782c-bdd8-4708-9986-a9135cb2fd4c response_code = 200 uri = /vpc-routes
22852025-01-08T15:25:49.050ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
22862025-01-08T15:25:49.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46040 req_id = bc1023f2-bde1-4df2-92fe-9e14ea9538ea response_code = 204 uri = /eip-gateways
22872025-01-08T15:25:49.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46040 req_id = 45b6596a-7357-46b6-b60e-e61d737fcf17 response_code = 204 uri = /vpc-routes
22882025-01-08T15:25:49.105ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
22892025-01-08T15:25:49.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39449 req_id = 38dc7a4f-2c19-4971-ab00-4dfb6e89faf0 response_code = 204 uri = /eip-gateways
22902025-01-08T15:25:49.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 328 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39449 req_id = 8445781b-125d-44ba-a762-7cd6760c3abc response_code = 204 uri = /vpc-routes
22912025-01-08T15:25:49.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54620
22922025-01-08T15:25:49.201ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22932025-01-08T15:25:49.242ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22942025-01-08T15:25:49.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103444 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54620 req_id = 11ec6e6f-ae0d-4463-921d-6e81c5d2c94f response_code = 204 uri = /switch-ports
22952025-01-08T15:25:49.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64834
22962025-01-08T15:25:49.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65293
22972025-01-08T15:25:49.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42869
22982025-01-08T15:25:49.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54620 req_id = d1755d38-9174-4e5b-8325-361c18c094a2 response_code = 200 uri = /network-bootstore-config
22992025-01-08T15:25:49.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64834 req_id = ecd78a83-5664-40c4-827d-0db68dd63aa2 response_code = 200 uri = /v2p
23002025-01-08T15:25:49.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42869 req_id = 17196222-229c-4d65-8fdd-16751ea98f52 response_code = 200 uri = /v2p
23012025-01-08T15:25:49.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65293 req_id = 25714818-2c25-4340-b885-22013582249d response_code = 200 uri = /v2p
23022025-01-08T15:25:49.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61297
23032025-01-08T15:25:49.315ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23042025-01-08T15:25:49.355ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23052025-01-08T15:25:49.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54511
23062025-01-08T15:25:49.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54511 req_id = a95af765-72be-4a03-817e-ab6fff323204 response_code = 200 uri = /vpc-routes
23072025-01-08T15:25:49.410ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61297 req_id = a596a0fd-867a-431a-9b76-db20d34511fa response_code = 204 uri = /switch-ports
23082025-01-08T15:25:49.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61297 req_id = 5761b3d7-3926-4907-a140-bba161ecfed1 response_code = 200 uri = /network-bootstore-config
23092025-01-08T15:25:49.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
23102025-01-08T15:25:49.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54511 req_id = 230611b5-8f8a-49a9-9c50-fdbe52317c47 response_code = 204 uri = /eip-gateways
23112025-01-08T15:25:49.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 236 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54511 req_id = 6af7699f-a680-415a-93ba-8af1b9f87be4 response_code = 204 uri = /vpc-routes
23122025-01-08T15:25:49.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43507
23132025-01-08T15:25:49.495ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23142025-01-08T15:25:49.533ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23152025-01-08T15:25:49.586ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43507 req_id = b2039dd6-3466-4fed-8ed6-8b586ef8cb9a response_code = 204 uri = /switch-ports
23162025-01-08T15:25:49.591ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43507 req_id = 6a4d7625-a010-4ae9-906f-72b8ec9fad75 response_code = 200 uri = /network-bootstore-config
23172025-01-08T15:25:55.395ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59667
23182025-01-08T15:25:55.395ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59667 req_id = 104a4838-0665-4462-82f2-3c4d0603a0b0 response_code = 200 uri = /baseboard
23192025-01-08T15:26:06.809ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8945 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 0eff3656-0f3c-41db-97ef-04b73f215c43 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
23202025-01-08T15:26:18.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64212
23212025-01-08T15:26:18.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64212 req_id = ff51ddf2-c23f-42a4-ba60-fcb3ed9d66cc response_code = 200 uri = /vpc-routes
23222025-01-08T15:26:18.869ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59996
23232025-01-08T15:26:18.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59996 req_id = 2a04cad8-e5b2-4627-b3fe-ae1f6dd4f48d response_code = 200 uri = /vpc-routes
23242025-01-08T15:26:18.926ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
23252025-01-08T15:26:18.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59996 req_id = 725b8209-f1bc-4b01-a278-a03911f41baa response_code = 204 uri = /eip-gateways
23262025-01-08T15:26:18.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
23272025-01-08T15:26:18.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64212 req_id = 23a60bf8-1a9d-4ce7-bf27-380d15895944 response_code = 204 uri = /eip-gateways
23282025-01-08T15:26:18.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59996 req_id = 7d6d677c-aac5-4d3b-aefa-a1d2e497e547 response_code = 204 uri = /vpc-routes
23292025-01-08T15:26:18.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34110
23302025-01-08T15:26:18.957ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23312025-01-08T15:26:18.998ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23322025-01-08T15:26:19.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106497 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34110 req_id = e89a5d66-47fb-4a20-95ed-a6fd2bcd8971 response_code = 204 uri = /switch-ports
23332025-01-08T15:26:19.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33461
23342025-01-08T15:26:19.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56203
23352025-01-08T15:26:19.064ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38011
23362025-01-08T15:26:19.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 438 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64212 req_id = 0a01d0c0-8e78-4c55-9b4d-2272dd848060 response_code = 204 uri = /vpc-routes
23372025-01-08T15:26:19.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34110 req_id = 741e0e0c-fcae-4d4b-a044-c3a02e029a0f response_code = 200 uri = /network-bootstore-config
23382025-01-08T15:26:19.065ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23392025-01-08T15:26:19.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33461 req_id = 2d9cc5eb-ed9e-4414-974b-8a830987962d response_code = 200 uri = /v2p
23402025-01-08T15:26:19.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38011 req_id = 0e75e43e-f518-4a56-950b-f8eacc050dbc response_code = 200 uri = /v2p
23412025-01-08T15:26:19.083ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47910
23422025-01-08T15:26:19.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47910 req_id = 36a05448-8096-4381-b3eb-a1ffc2ecf6ae response_code = 200 uri = /vpc-routes
23432025-01-08T15:26:19.101ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
23442025-01-08T15:26:19.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47910 req_id = bc3e34a1-39f3-4d31-81df-f10dbe679402 response_code = 204 uri = /eip-gateways
23452025-01-08T15:26:19.105ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23462025-01-08T15:26:19.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47910 req_id = ad890082-effa-426e-9fb1-8761fe2df4ac response_code = 204 uri = /vpc-routes
23472025-01-08T15:26:19.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97536 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56203 req_id = 67ba27e1-2f90-4a7a-bdd4-f01cd797f1b5 response_code = 204 uri = /switch-ports
23482025-01-08T15:26:19.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56203 req_id = 2ac45168-b6f8-42bf-bcf7-72b9258d3247 response_code = 200 uri = /network-bootstore-config
23492025-01-08T15:26:19.185ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52583
23502025-01-08T15:26:19.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52583 req_id = f58b9481-13ea-47c0-bd91-d76357086e95 response_code = 200 uri = /v2p
23512025-01-08T15:26:19.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43828
23522025-01-08T15:26:19.234ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23532025-01-08T15:26:19.267ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23542025-01-08T15:26:19.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85695 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43828 req_id = cd497476-eb0d-4a59-9101-da00916575aa response_code = 204 uri = /switch-ports
23552025-01-08T15:26:19.320ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43828 req_id = 4eed8283-0d3b-4ecc-8874-3f08f11b4960 response_code = 200 uri = /network-bootstore-config
23562025-01-08T15:26:25.428ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50347
23572025-01-08T15:26:25.428ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50347 req_id = 37aac870-be63-40e8-a71d-8dff08645bc3 response_code = 200 uri = /baseboard
23582025-01-08T15:26:36.807ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7303 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = a4b13d2e-d35c-4b24-8c53-0a1927d2143e response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
23592025-01-08T15:26:48.957ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39797
23602025-01-08T15:26:48.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39797 req_id = 8da4b3ac-3420-4cd4-a08c-63c65b2a0752 response_code = 200 uri = /vpc-routes
23612025-01-08T15:26:48.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43565
23622025-01-08T15:26:48.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43565 req_id = 4a6399a6-ce9f-4206-8492-4a5bb256ac0c response_code = 200 uri = /vpc-routes
23632025-01-08T15:26:49.026ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
23642025-01-08T15:26:49.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39797 req_id = 8154f011-1ffa-4ad0-b136-e157ff31da3d response_code = 204 uri = /eip-gateways
23652025-01-08T15:26:49.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39797 req_id = c0776d35-5e2c-48b2-bf8f-f3700c4d526f response_code = 204 uri = /vpc-routes
23662025-01-08T15:26:49.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
23672025-01-08T15:26:49.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43565 req_id = 5bc07a51-db74-4e4a-a0fb-08386697c714 response_code = 204 uri = /eip-gateways
23682025-01-08T15:26:49.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43565 req_id = f69f2a2f-3283-41c9-b7e3-11d1afc53263 response_code = 204 uri = /vpc-routes
23692025-01-08T15:26:49.141ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56706
23702025-01-08T15:26:49.141ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23712025-01-08T15:26:49.181ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23722025-01-08T15:26:49.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101117 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56706 req_id = 947dfff7-cbed-4802-8912-755668b34f87 response_code = 204 uri = /switch-ports
23732025-01-08T15:26:49.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42246
23742025-01-08T15:26:49.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49890
23752025-01-08T15:26:49.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41024
23762025-01-08T15:26:49.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41024 req_id = f994a7f4-7e6d-47fb-8947-5f1ca452bd6e response_code = 200 uri = /v2p
23772025-01-08T15:26:49.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56706 req_id = 031445e6-79d0-4a14-915c-1559e1686940 response_code = 200 uri = /network-bootstore-config
23782025-01-08T15:26:49.243ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23792025-01-08T15:26:49.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42246 req_id = bfd6416b-bce0-41a0-92d5-21e6d2d2ad9a response_code = 200 uri = /v2p
23802025-01-08T15:26:49.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56624
23812025-01-08T15:26:49.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56624 req_id = b039bdc0-8904-4da8-aed0-a2907439609f response_code = 200 uri = /vpc-routes
23822025-01-08T15:26:49.280ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23832025-01-08T15:26:49.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
23842025-01-08T15:26:49.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56624 req_id = 93f0e68e-8596-46e2-87b3-bfa25c038d55 response_code = 204 uri = /eip-gateways
23852025-01-08T15:26:49.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 606 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56624 req_id = 43603e1f-6826-431d-ad60-0b92caf6baf9 response_code = 204 uri = /vpc-routes
23862025-01-08T15:26:49.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100095 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49890 req_id = a91a099d-325c-4895-a79a-e1c794e3e5d5 response_code = 204 uri = /switch-ports
23872025-01-08T15:26:49.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49890 req_id = 442fc699-8863-4bc4-b1cd-c5c1de24170b response_code = 200 uri = /network-bootstore-config
23882025-01-08T15:26:49.391ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51273
23892025-01-08T15:26:49.391ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23902025-01-08T15:26:49.426ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23912025-01-08T15:26:49.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87681 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51273 req_id = 9f843b17-c602-480a-9be6-ea98cbeeed94 response_code = 204 uri = /switch-ports
23922025-01-08T15:26:49.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35728
23932025-01-08T15:26:49.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35728 req_id = 1c0cfe85-5123-45cc-b00a-7d31c82f336c response_code = 200 uri = /v2p
23942025-01-08T15:26:49.479ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51273 req_id = 46e99a6a-d7e8-416f-addf-d5a9edc58e9d response_code = 200 uri = /network-bootstore-config
23952025-01-08T15:26:55.461ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42083
23962025-01-08T15:26:55.462ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42083 req_id = 72097fe6-33ff-4db5-a25b-278a39f77111 response_code = 200 uri = /baseboard
23972025-01-08T15:27:06.808ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8242 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 89abd65d-195f-448a-9505-b2b21136d41d response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
23982025-01-08T15:27:18.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55340
23992025-01-08T15:27:18.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55340 req_id = 9e6aa6c5-b4a6-468e-a95e-1afe60ede939 response_code = 200 uri = /vpc-routes
24002025-01-08T15:27:18.833ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60507
24012025-01-08T15:27:18.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60507 req_id = 4539e621-92de-4aa6-9328-63f4af992b44 response_code = 200 uri = /vpc-routes
24022025-01-08T15:27:18.835ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
24032025-01-08T15:27:18.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55340 req_id = 15a0d0cf-1b24-477f-8b03-85d251588762 response_code = 204 uri = /eip-gateways
24042025-01-08T15:27:18.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55340 req_id = 66b2a9c5-612b-4fde-a16e-4a715a198e6f response_code = 204 uri = /vpc-routes
24052025-01-08T15:27:18.878ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
24062025-01-08T15:27:18.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60507 req_id = 6248ffeb-4d6f-4c7c-bcf5-75029ca84e31 response_code = 204 uri = /eip-gateways
24072025-01-08T15:27:18.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60507 req_id = 74504ed1-fe45-46fc-a607-c2f0c7a4aa4d response_code = 204 uri = /vpc-routes
24082025-01-08T15:27:18.891ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33754
24092025-01-08T15:27:18.891ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24102025-01-08T15:27:18.946ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24112025-01-08T15:27:19.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33754 req_id = d200852b-9a35-48b3-a436-2493853dd874 response_code = 204 uri = /switch-ports
24122025-01-08T15:27:19.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34848
24132025-01-08T15:27:19.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47564
24142025-01-08T15:27:19.017ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24152025-01-08T15:27:19.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33754 req_id = 863fe15e-87f2-48d8-ba95-0d8ec6c66728 response_code = 200 uri = /network-bootstore-config
24162025-01-08T15:27:19.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34848 req_id = af7a7c8e-a352-4c24-b43a-194f21f177e5 response_code = 200 uri = /v2p
24172025-01-08T15:27:19.055ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24182025-01-08T15:27:19.059ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60454
24192025-01-08T15:27:19.059ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 253 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60454 req_id = 4c797067-70b6-4915-9a9c-d41756fe389d response_code = 200 uri = /v2p
24202025-01-08T15:27:19.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96663 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47564 req_id = 9b455efd-0366-4106-a805-4279db55486c response_code = 204 uri = /switch-ports
24212025-01-08T15:27:19.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47564 req_id = 416cd47f-3859-4ce4-8e83-38f5b65fb4d5 response_code = 200 uri = /network-bootstore-config
24222025-01-08T15:27:19.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45819
24232025-01-08T15:27:19.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45819 req_id = 6266515f-711e-4ce9-8ae3-9384be8d3974 response_code = 200 uri = /vpc-routes
24242025-01-08T15:27:19.157ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
24252025-01-08T15:27:19.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45819 req_id = 70086ece-efde-448a-9591-adbd60ab8fdc response_code = 204 uri = /eip-gateways
24262025-01-08T15:27:19.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 433 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45819 req_id = e2f0200b-88d8-4e0a-a7f9-7ed3db8f61bb response_code = 204 uri = /vpc-routes
24272025-01-08T15:27:19.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49824
24282025-01-08T15:27:19.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49824 req_id = 2d8a20c2-98b4-446f-8ab4-fea6659136da response_code = 200 uri = /v2p
24292025-01-08T15:27:19.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60245
24302025-01-08T15:27:19.245ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24312025-01-08T15:27:19.279ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24322025-01-08T15:27:19.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87321 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60245 req_id = fb383188-70ff-4caf-967f-e02585849d78 response_code = 204 uri = /switch-ports
24332025-01-08T15:27:19.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60245 req_id = 2bcfb563-45f5-4472-9ef7-db5f2820600e response_code = 200 uri = /network-bootstore-config
24342025-01-08T15:27:25.497ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41764
24352025-01-08T15:27:25.497ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41764 req_id = 96dfd45d-5587-4b18-a4d2-d808ac154f74 response_code = 200 uri = /baseboard
24362025-01-08T15:27:31.716ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24372025-01-08T15:27:31.717ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24382025-01-08T15:27:31.752ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 37815, tv_nsec: 883040934 } time_to_next_cleanup = 599.99999816s
24392025-01-08T15:27:36.809ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8803 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 65086f79-241c-4d43-a9a5-fcc0499002c3 response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
24402025-01-08T15:27:46.131ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24412025-01-08T15:27:48.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57466
24422025-01-08T15:27:48.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57466 req_id = 70cbbe3b-fedd-4608-838a-6c9fa8365337 response_code = 200 uri = /vpc-routes
24432025-01-08T15:27:48.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
24442025-01-08T15:27:48.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57466 req_id = 8f74734b-38bc-48cb-8a62-b371e31b0c8e response_code = 204 uri = /eip-gateways
24452025-01-08T15:27:49.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57466 req_id = a01eb77e-7729-4c30-a3fc-a8de15304d44 response_code = 204 uri = /vpc-routes
24462025-01-08T15:27:49.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59152
24472025-01-08T15:27:49.082ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24482025-01-08T15:27:49.120ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24492025-01-08T15:27:49.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95769 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59152 req_id = 7ea70c8c-bb74-432e-b7af-8ec9555422f4 response_code = 204 uri = /switch-ports
24502025-01-08T15:27:49.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35188
24512025-01-08T15:27:49.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46022
24522025-01-08T15:27:49.178ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42687
24532025-01-08T15:27:49.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59152 req_id = e3f71d3f-176d-475c-98a3-a5f093a1bafc response_code = 200 uri = /network-bootstore-config
24542025-01-08T15:27:49.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46022 req_id = 4b35c4d1-a94e-42cf-b26f-e082d441a870 response_code = 200 uri = /vpc-routes
24552025-01-08T15:27:49.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42687 req_id = f6dd92ef-2324-49b3-9179-f75ed95318d1 response_code = 200 uri = /v2p
24562025-01-08T15:27:49.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35188 req_id = 7e0ae5d3-e0b6-489b-b4e4-254e7da32cf4 response_code = 200 uri = /v2p
24572025-01-08T15:27:49.198ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
24582025-01-08T15:27:49.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46022 req_id = 641de8d6-e4b8-4af0-bf47-ede1710ac7a4 response_code = 204 uri = /eip-gateways
24592025-01-08T15:27:49.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46022 req_id = 81576e74-b4bc-4c5c-ae88-ec4e165a7372 response_code = 204 uri = /vpc-routes
24602025-01-08T15:27:49.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54655
24612025-01-08T15:27:49.212ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24622025-01-08T15:27:49.244ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24632025-01-08T15:27:49.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54655 req_id = 5fdc7e58-39b5-4669-90f0-ed08838d2ca5 response_code = 204 uri = /switch-ports
24642025-01-08T15:27:49.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54655 req_id = 382efc6b-5b38-484c-88e5-d99f7a61b030 response_code = 200 uri = /network-bootstore-config
24652025-01-08T15:27:49.298ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61385
24662025-01-08T15:27:49.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61385 req_id = 846d5c6e-b7fe-4a96-ba56-26743831c43a response_code = 200 uri = /vpc-routes
24672025-01-08T15:27:49.356ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
24682025-01-08T15:27:49.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61385 req_id = bbe0197c-a210-44c4-94eb-3fc3e1bbf954 response_code = 204 uri = /eip-gateways
24692025-01-08T15:27:49.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61385 req_id = 5c55398c-daa8-44ad-bbc5-bfcb126371b3 response_code = 204 uri = /vpc-routes
24702025-01-08T15:27:49.489ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36219
24712025-01-08T15:27:49.489ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24722025-01-08T15:27:49.527ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24732025-01-08T15:27:49.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36219 req_id = 21629296-e0d0-4b17-b05f-a2dba624cdc1 response_code = 204 uri = /switch-ports
24742025-01-08T15:27:49.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37023
24752025-01-08T15:27:49.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37023 req_id = bd493774-2622-43ab-84ad-519a27461769 response_code = 200 uri = /v2p
24762025-01-08T15:27:49.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36219 req_id = 26b62354-6e85-4da6-a567-e465d6f692d0 response_code = 200 uri = /network-bootstore-config
24772025-01-08T15:27:55.530ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51002
24782025-01-08T15:27:55.530ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51002 req_id = 1a3a554e-3ebf-4092-b891-bfdfc7f80bc9 response_code = 200 uri = /baseboard
24792025-01-08T15:28:06.808ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8401 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = ad37e3ab-6f16-43a4-b3cf-19ffd4eee90e response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
24802025-01-08T15:28:18.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40400
24812025-01-08T15:28:18.847ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40400 req_id = 099f3b85-3286-4bff-ad46-015c43ffb02b response_code = 200 uri = /v2p
24822025-01-08T15:28:18.944ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60598
24832025-01-08T15:28:18.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60598 req_id = aeef83b7-219e-46b1-8178-f21d1421ed5a response_code = 200 uri = /vpc-routes
24842025-01-08T15:28:18.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64710
24852025-01-08T15:28:18.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64710 req_id = d45d89e0-4a31-4692-a583-65c2e42bac2f response_code = 200 uri = /vpc-routes
24862025-01-08T15:28:18.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
24872025-01-08T15:28:18.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60598 req_id = 4d4a8b11-8423-4bc1-aec3-f676bd256527 response_code = 204 uri = /eip-gateways
24882025-01-08T15:28:19.004ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
24892025-01-08T15:28:19.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64710 req_id = 161dded7-aa7d-4f4c-a7a2-37969f94d218 response_code = 204 uri = /eip-gateways
24902025-01-08T15:28:19.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60598 req_id = 6b6ad3ec-1609-4cae-a362-c7cbfecb8503 response_code = 204 uri = /vpc-routes
24912025-01-08T15:28:19.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64710 req_id = 2107db3c-781b-45af-9ca5-5bff80896852 response_code = 204 uri = /vpc-routes
24922025-01-08T15:28:19.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51611
24932025-01-08T15:28:19.016ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24942025-01-08T15:28:19.058ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24952025-01-08T15:28:19.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101867 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51611 req_id = 1b854218-c2fc-49db-bc92-6da343f9f2e6 response_code = 204 uri = /switch-ports
24962025-01-08T15:28:19.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51349
24972025-01-08T15:28:19.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42266
24982025-01-08T15:28:19.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57850
24992025-01-08T15:28:19.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25002025-01-08T15:28:19.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51611 req_id = 84f8e7aa-35be-4e90-a27b-35c59c184fad response_code = 200 uri = /network-bootstore-config
25012025-01-08T15:28:19.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3714 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42266 req_id = 77411e8a-4876-4fe1-a682-688c1daa37ae response_code = 200 uri = /v2p
25022025-01-08T15:28:19.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57850 req_id = 462a39f2-2c12-4946-8f02-4c2844e6f032 response_code = 200 uri = /vpc-routes
25032025-01-08T15:28:19.137ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
25042025-01-08T15:28:19.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57850 req_id = 0932db5a-bfa2-44ea-adb6-715a1b16522b response_code = 204 uri = /eip-gateways
25052025-01-08T15:28:19.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 876 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57850 req_id = 012e4f85-1cd0-4b2f-921f-f2146f4123d5 response_code = 204 uri = /vpc-routes
25062025-01-08T15:28:19.157ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25072025-01-08T15:28:19.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43671
25082025-01-08T15:28:19.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43671 req_id = e2a2d398-9de3-458a-b016-153064d1ec5d response_code = 200 uri = /v2p
25092025-01-08T15:28:19.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43766
25102025-01-08T15:28:19.214ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25112025-01-08T15:28:19.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96542 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51349 req_id = ceb9dc7f-e919-4b43-9242-50e679dea3ba response_code = 204 uri = /switch-ports
25122025-01-08T15:28:19.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 745 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51349 req_id = 0b9ba901-104f-4fcc-a461-f088cabe22d9 response_code = 200 uri = /network-bootstore-config
25132025-01-08T15:28:19.252ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25142025-01-08T15:28:19.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112018 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43766 req_id = d84b4671-7296-4d02-9c25-f4cf39ca5336 response_code = 204 uri = /switch-ports
25152025-01-08T15:28:19.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43766 req_id = d6a94a32-b609-4287-9d3c-b259a0e79acc response_code = 200 uri = /network-bootstore-config
25162025-01-08T15:28:25.564ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:63669
25172025-01-08T15:28:25.565ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:63669 req_id = 344a1a08-b6cc-47d1-b116-8a5a342b6cdc response_code = 200 uri = /baseboard
25182025-01-08T15:28:36.809ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8421 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 3af07931-9cff-4486-8a92-de43585c573f response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
25192025-01-08T15:28:49.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33284
25202025-01-08T15:28:49.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33284 req_id = a60451bc-99cd-40c0-9520-fb69309bc26e response_code = 200 uri = /vpc-routes
25212025-01-08T15:28:49.104ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
25222025-01-08T15:28:49.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33284 req_id = bf2aff8d-4f65-49c8-a127-de611a0f9c0f response_code = 204 uri = /eip-gateways
25232025-01-08T15:28:49.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44346
25242025-01-08T15:28:49.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44346 req_id = b08ec180-c9f5-4663-bcc0-f96a7a5e375b response_code = 200 uri = /vpc-routes
25252025-01-08T15:28:49.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33284 req_id = d1d77650-25d0-4981-a610-6cbf38978417 response_code = 204 uri = /vpc-routes
25262025-01-08T15:28:49.128ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47976
25272025-01-08T15:28:49.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47976 req_id = 5f0d436e-a82c-4c02-9c92-0f49a03c23a2 response_code = 200 uri = /vpc-routes
25282025-01-08T15:28:49.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56655
25292025-01-08T15:28:49.155ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25302025-01-08T15:28:49.205ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25312025-01-08T15:28:49.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119059 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56655 req_id = 42fe2c13-356f-49c6-b3c0-7f09312cd133 response_code = 204 uri = /switch-ports
25322025-01-08T15:28:49.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60594
25332025-01-08T15:28:49.275ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
25342025-01-08T15:28:49.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44346 req_id = 28d9b248-9e51-430e-bfd7-52eca1267ba7 response_code = 204 uri = /eip-gateways
25352025-01-08T15:28:49.275ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
25362025-01-08T15:28:49.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47976 req_id = 873422e1-6329-45d0-9df3-957fc240174b response_code = 204 uri = /eip-gateways
25372025-01-08T15:28:49.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56655 req_id = b03a8e6c-35ff-4789-a380-af73931b6f47 response_code = 200 uri = /network-bootstore-config
25382025-01-08T15:28:49.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60594 req_id = 7f1e9135-204c-45e4-9768-b6c0aee44ec4 response_code = 200 uri = /v2p
25392025-01-08T15:28:49.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 324 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44346 req_id = 65697ca8-6496-4719-98cd-5e1342540649 response_code = 204 uri = /vpc-routes
25402025-01-08T15:28:49.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47703
25412025-01-08T15:28:49.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47703 req_id = 04c9049d-4200-4bdf-89e6-4375c1edfd97 response_code = 200 uri = /v2p
25422025-01-08T15:28:49.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47976 req_id = b2d4aec1-0972-444a-96aa-6c343ab77fef response_code = 204 uri = /vpc-routes
25432025-01-08T15:28:49.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62612
25442025-01-08T15:28:49.308ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25452025-01-08T15:28:49.347ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25462025-01-08T15:28:49.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91602 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62612 req_id = 01acf089-c234-498b-a3a1-d03d79bc1e80 response_code = 204 uri = /switch-ports
25472025-01-08T15:28:49.400ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39337
25482025-01-08T15:28:49.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62612 req_id = 53898b77-a424-46fe-94f7-bc280daad9e0 response_code = 200 uri = /network-bootstore-config
25492025-01-08T15:28:49.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39337 req_id = 83e21f64-5bfa-49c6-8bc2-9930fc4f1cbb response_code = 200 uri = /v2p
25502025-01-08T15:28:49.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53933
25512025-01-08T15:28:49.490ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25522025-01-08T15:28:49.528ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25532025-01-08T15:28:49.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94243 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53933 req_id = e72b33fd-dfef-4cb0-ad11-77c2c9ecb74d response_code = 204 uri = /switch-ports
25542025-01-08T15:28:49.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53933 req_id = 075ec7d5-bd87-45c8-b46a-46525bc19a21 response_code = 200 uri = /network-bootstore-config
25552025-01-08T15:28:55.600ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40963
25562025-01-08T15:28:55.601ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40963 req_id = a7cb9cec-c2b6-45c8-ab0e-74c2e969f1a5 response_code = 200 uri = /baseboard
25572025-01-08T15:29:06.809ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8000 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 2d0a10d6-b4ae-4de2-9262-964a64015a3e response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
25582025-01-08T15:29:18.896ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47389
25592025-01-08T15:29:18.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47389 req_id = f34d6a78-b532-4a86-a6f8-cb589c9366cb response_code = 200 uri = /vpc-routes
25602025-01-08T15:29:18.916ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
25612025-01-08T15:29:18.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47389 req_id = 1b294b8a-974c-4558-91fd-f02cf97dd513 response_code = 204 uri = /eip-gateways
25622025-01-08T15:29:18.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 333 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47389 req_id = dbd09c17-4fa7-4a74-9e0d-f0141103a39e response_code = 204 uri = /vpc-routes
25632025-01-08T15:29:18.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46930
25642025-01-08T15:29:18.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46930 req_id = 6c9968cc-9484-4187-8b92-89e3d05806cc response_code = 200 uri = /vpc-routes
25652025-01-08T15:29:18.993ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
25662025-01-08T15:29:18.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46930 req_id = eb44c527-9124-4233-84f5-d0a1767dafb6 response_code = 204 uri = /eip-gateways
25672025-01-08T15:29:19.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43063
25682025-01-08T15:29:19.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43063 req_id = a44f8c9c-d0ea-4749-b76e-a66209388e85 response_code = 200 uri = /v2p
25692025-01-08T15:29:19.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32821
25702025-01-08T15:29:19.018ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25712025-01-08T15:29:19.058ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25722025-01-08T15:29:19.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97782 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32821 req_id = 005bb5bf-930a-4770-8ce8-7431c15a5245 response_code = 204 uri = /switch-ports
25732025-01-08T15:29:19.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53224
25742025-01-08T15:29:19.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49159
25752025-01-08T15:29:19.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 323 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32821 req_id = d2d9319c-7b19-40db-b71c-e7ff2326fa6a response_code = 200 uri = /network-bootstore-config
25762025-01-08T15:29:19.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53224 req_id = 9ca6ff38-0a07-4911-a3c4-73974816ca28 response_code = 200 uri = /v2p
25772025-01-08T15:29:19.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 482 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46930 req_id = 32257a01-7e17-45a2-a603-5cfe9d15d9a2 response_code = 204 uri = /vpc-routes
25782025-01-08T15:29:19.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25792025-01-08T15:29:19.155ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25802025-01-08T15:29:19.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57989
25812025-01-08T15:29:19.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57989 req_id = 405540b7-7122-4b27-8efa-cb3c6eb4a07f response_code = 200 uri = /vpc-routes
25822025-01-08T15:29:19.191ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
25832025-01-08T15:29:19.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57989 req_id = 88b81803-f12d-44ce-820c-024b994dbcba response_code = 204 uri = /eip-gateways
25842025-01-08T15:29:19.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53377
25852025-01-08T15:29:19.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53377 req_id = 1fa79619-29e4-4584-94ed-297cd6345a66 response_code = 200 uri = /v2p
25862025-01-08T15:29:19.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57989 req_id = 0932530d-d0a7-4d59-ba21-51db898f8e41 response_code = 204 uri = /vpc-routes
25872025-01-08T15:29:19.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89688 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49159 req_id = ae8e2ae2-e562-4051-8473-1a7c6c319112 response_code = 204 uri = /switch-ports
25882025-01-08T15:29:19.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49159 req_id = 5afbb47f-a765-43d1-bade-bc98fcd65baf response_code = 200 uri = /network-bootstore-config
25892025-01-08T15:29:19.229ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48771
25902025-01-08T15:29:19.229ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25912025-01-08T15:29:19.262ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25922025-01-08T15:29:19.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92537 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:48771 req_id = c0d59b7c-04cc-4eea-867d-6d827cc358e4 response_code = 204 uri = /switch-ports
25932025-01-08T15:29:19.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48771 req_id = ff323672-7207-461d-881c-2d71f63dd809 response_code = 200 uri = /network-bootstore-config
25942025-01-08T15:29:25.633ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42809
25952025-01-08T15:29:25.633ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42809 req_id = e73c9a17-676e-4d5d-bf31-499f0c1bd18f response_code = 200 uri = /baseboard
25962025-01-08T15:29:36.809ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8321 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 4db7eefb-50ce-446b-928c-878b9d8f9bcb response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
25972025-01-08T15:29:48.798ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56392
25982025-01-08T15:29:48.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56392 req_id = 99603fab-066b-4e9b-b876-56fcb5269834 response_code = 200 uri = /vpc-routes
25992025-01-08T15:29:48.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44907
26002025-01-08T15:29:48.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44907 req_id = 0df43e62-b969-49fc-a528-a722c6b2b966 response_code = 200 uri = /vpc-routes
26012025-01-08T15:29:48.884ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
26022025-01-08T15:29:48.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56392 req_id = ae075586-9486-4d77-a255-0bfeba321bc8 response_code = 204 uri = /eip-gateways
26032025-01-08T15:29:48.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56392 req_id = be3a902b-09b7-4e8b-be2c-91a888315b6d response_code = 204 uri = /vpc-routes
26042025-01-08T15:29:48.977ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
26052025-01-08T15:29:48.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44907 req_id = 6f960b87-a290-498f-a458-9c96c9219994 response_code = 204 uri = /eip-gateways
26062025-01-08T15:29:49.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44907 req_id = 60541fd3-cff6-41cd-b94f-06fb8954daed response_code = 204 uri = /vpc-routes
26072025-01-08T15:29:49.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53732
26082025-01-08T15:29:49.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53732 req_id = 1b90666f-2cb8-480f-8524-38dcd4688a9c response_code = 200 uri = /v2p
26092025-01-08T15:29:49.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54461
26102025-01-08T15:29:49.204ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26112025-01-08T15:29:49.204ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26122025-01-08T15:29:49.204ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:177
26132025-01-08T15:29:49.205ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:177
26142025-01-08T15:29:49.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46128
26152025-01-08T15:29:49.220ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26162025-01-08T15:29:49.220ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc669d0-0094-4137-bc22-36487a33d705
26172025-01-08T15:29:49.224ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26182025-01-08T15:29:49.247ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26192025-01-08T15:29:49.247ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b68c2a96-30ec-49d6-a55f-078a6befe678
26202025-01-08T15:29:49.271ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26212025-01-08T15:29:49.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58138
26222025-01-08T15:29:49.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58138 req_id = 6d093a43-4790-453d-91fe-d1562209b66c response_code = 200 uri = /v2p
26232025-01-08T15:29:49.281ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26242025-01-08T15:29:49.281ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9
26252025-01-08T15:29:49.311ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26262025-01-08T15:29:49.311ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2838adfd-6724-4d11-9727-968f07762cf0
26272025-01-08T15:29:49.322ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59833
26282025-01-08T15:29:49.323ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26292025-01-08T15:29:49.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26302025-01-08T15:29:49.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26312025-01-08T15:29:49.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26322025-01-08T15:29:49.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26332025-01-08T15:29:49.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26342025-01-08T15:29:49.323ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26352025-01-08T15:29:49.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 658 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59833 req_id = 06af266f-14a3-47d4-94eb-d77b61fb0e90 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26362025-01-08T15:29:49.338ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26372025-01-08T15:29:49.338ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f80f84fb-0d35-46c9-a329-b7397a036f55
26382025-01-08T15:29:49.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48349
26392025-01-08T15:29:49.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26402025-01-08T15:29:49.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125021 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46128 req_id = c72ff932-80a8-4717-ac3c-cbf4cf8e7a73 response_code = 204 uri = /switch-ports
26412025-01-08T15:29:49.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 715 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46128 req_id = 4c171149-f15e-4d3f-ab93-5f45ed676e89 response_code = 200 uri = /network-bootstore-config
26422025-01-08T15:29:49.364ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26432025-01-08T15:29:49.365ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46
26442025-01-08T15:29:49.369ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57261
26452025-01-08T15:29:49.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57261 req_id = 0a7edeed-2089-4a88-bc7c-f4628fa6e665 response_code = 200 uri = /v2p
26462025-01-08T15:29:49.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33142
26472025-01-08T15:29:49.378ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26482025-01-08T15:29:49.378ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26492025-01-08T15:29:49.378ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:177
26502025-01-08T15:29:49.383ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:177
26512025-01-08T15:29:49.387ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26522025-01-08T15:29:49.392ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26532025-01-08T15:29:49.392ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60
26542025-01-08T15:29:49.406ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26552025-01-08T15:29:49.406ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc669d0-0094-4137-bc22-36487a33d705
26562025-01-08T15:29:49.411ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36362
26572025-01-08T15:29:49.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36362 req_id = 02e1659a-f6d2-4978-be00-57a7f1075158 response_code = 200 uri = /vpc-routes
26582025-01-08T15:29:49.439ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26592025-01-08T15:29:49.439ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b68c2a96-30ec-49d6-a55f-078a6befe678
26602025-01-08T15:29:49.456ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26612025-01-08T15:29:49.456ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae
26622025-01-08T15:29:49.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122237 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48349 req_id = 70a18b8e-4d21-446c-9f78-d375058ded20 response_code = 204 uri = /switch-ports
26632025-01-08T15:29:49.465ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
26642025-01-08T15:29:49.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 659 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36362 req_id = f70119f0-bb5b-48fc-baa1-ec6184e3a1ce response_code = 204 uri = /eip-gateways
26652025-01-08T15:29:49.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48349 req_id = 19db3299-cc23-4f12-9f25-79ac1a3d3165 response_code = 200 uri = /network-bootstore-config
26662025-01-08T15:29:49.475ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26672025-01-08T15:29:49.475ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9
26682025-01-08T15:29:49.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47494
26692025-01-08T15:29:49.487ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26702025-01-08T15:29:49.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26712025-01-08T15:29:49.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26722025-01-08T15:29:49.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26732025-01-08T15:29:49.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26742025-01-08T15:29:49.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26752025-01-08T15:29:49.488ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26762025-01-08T15:29:49.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 446 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47494 req_id = a4ee96ec-50d8-428a-a2dc-82404e571f0c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26772025-01-08T15:29:49.489ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26782025-01-08T15:29:49.489ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a
26792025-01-08T15:29:49.507ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302953 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54461 req_id = 90ac26a7-bb7f-42b6-a34e-dd3dc0eef719 response_code = 200 uri = /inventory
26802025-01-08T15:29:49.513ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26812025-01-08T15:29:49.513ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2838adfd-6724-4d11-9727-968f07762cf0
26822025-01-08T15:29:49.540ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26832025-01-08T15:29:49.540ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f80f84fb-0d35-46c9-a329-b7397a036f55
26842025-01-08T15:29:49.551ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51070
26852025-01-08T15:29:49.552ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26862025-01-08T15:29:49.552ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26872025-01-08T15:29:49.552ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/config/omicron-zones.json file = common/src/ledger.rs:177
26882025-01-08T15:29:49.557ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/config/omicron-zones.json file = common/src/ledger.rs:177
26892025-01-08T15:29:49.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 669 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36362 req_id = bc362bfe-e477-431a-8b09-f90cc6135b3f response_code = 204 uri = /vpc-routes
26902025-01-08T15:29:49.564ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26912025-01-08T15:29:49.564ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46
26922025-01-08T15:29:49.577ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2bc669d0-0094-4137-bc22-36487a33d705 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26932025-01-08T15:29:49.577ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2bc669d0-0094-4137-bc22-36487a33d705
26942025-01-08T15:29:49.606ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b68c2a96-30ec-49d6-a55f-078a6befe678 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26952025-01-08T15:29:49.606ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b68c2a96-30ec-49d6-a55f-078a6befe678
26962025-01-08T15:29:49.610ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50522
26972025-01-08T15:29:49.610ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26982025-01-08T15:29:49.621ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26992025-01-08T15:29:49.621ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60
27002025-01-08T15:29:49.639ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 287fc1e8-f92d-41d2-96e3-902b3e7ba0f9 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27012025-01-08T15:29:49.640ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_287fc1e8-f92d-41d2-96e3-902b3e7ba0f9
27022025-01-08T15:29:49.656ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27032025-01-08T15:29:49.656ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae
27042025-01-08T15:29:49.660ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27052025-01-08T15:29:49.671ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44961
27062025-01-08T15:29:49.671ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1bb38e80-4825-48f8-bf20-6463b6ed2d6a, kind: Service { id: 4ac9516f-ce2b-441e-b6e1-c7e068dc9b60 }, name: Name("external-dns-4ac9516f-ce2b-441e-b6e1-c7e068dc9b60"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 240, 16])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bb769a8c-c341-444b-8c51-45747ca773fe, kind: Service { id: 546529ac-9cd3-4187-a253-14c651454456 }, name: Name("external-dns-546529ac-9cd3-4187-a253-14c651454456"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 157])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 423931dd-67c7-4d3e-8a92-89f708d69604, kind: Service { id: d06eb9fe-b4bf-480e-8744-c75f332edb8f }, name: Name("nexus-d06eb9fe-b4bf-480e-8744-c75f332edb8f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 181, 200])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: acf1e43d-a91b-4825-997b-9a8d866276b4, kind: Service { id: caa67412-bbaa-4cb8-ab7d-76f354f43ac6 }, name: Name("nexus-caa67412-bbaa-4cb8-ab7d-76f354f43ac6"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 176, 156])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: fe7942b9-46bd-4278-a3b6-bcb4cbb64ca4, kind: Service { id: 4cece465-e930-47ca-aa88-ed170e15d28a }, name: Name("nexus-4cece465-e930-47ca-aa88-ed170e15d28a"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 210, 34])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27072025-01-08T15:29:49.671ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27082025-01-08T15:29:49.675ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27092025-01-08T15:29:49.675ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27102025-01-08T15:29:49.675ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27112025-01-08T15:29:49.675ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27122025-01-08T15:29:49.675ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27132025-01-08T15:29:49.683ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44961 req_id = 4293998a-f6de-4a3d-ac66-6e22ac00deba response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27142025-01-08T15:29:49.683ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27152025-01-08T15:29:49.683ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a
27162025-01-08T15:29:49.697ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2838adfd-6724-4d11-9727-968f07762cf0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27172025-01-08T15:29:49.697ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2838adfd-6724-4d11-9727-968f07762cf0
27182025-01-08T15:29:49.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326445 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33142 req_id = d80b7961-11be-4608-bb22-4d31328b9ced response_code = 200 uri = /inventory
27192025-01-08T15:29:49.730ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f80f84fb-0d35-46c9-a329-b7397a036f55 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27202025-01-08T15:29:49.730ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f80f84fb-0d35-46c9-a329-b7397a036f55
27212025-01-08T15:29:49.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126187 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50522 req_id = bf0d82d2-53d7-4b18-8611-87849cf47228 response_code = 204 uri = /switch-ports
27222025-01-08T15:29:49.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50522 req_id = 815c32d1-3bb6-423d-b713-80b6b211b2e1 response_code = 200 uri = /network-bootstore-config
27232025-01-08T15:29:49.755ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 04d48b1d-c030-493d-84a2-8ba81e39ea46 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27242025-01-08T15:29:49.755ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_04d48b1d-c030-493d-84a2-8ba81e39ea46
27252025-01-08T15:29:49.779ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f4cfa29b-4024-4c00-b4a6-155ff6b9ea60 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27262025-01-08T15:29:49.779ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f4cfa29b-4024-4c00-b4a6-155ff6b9ea60
27272025-01-08T15:29:49.802ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27282025-01-08T15:29:49.803ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae
27292025-01-08T15:29:49.826ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: f3346ff5-16b1-43c2-a321-ba0fe5b4302a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27302025-01-08T15:29:49.826ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_f3346ff5-16b1-43c2-a321-ba0fe5b4302a
27312025-01-08T15:29:49.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 289845 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51070 req_id = a541b7e5-7bd7-4346-a338-7c8c60413eb8 response_code = 200 uri = /inventory
27322025-01-08T15:29:55.665ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:55669
27332025-01-08T15:29:55.665ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:55669 req_id = d7c14269-3bd2-4cd8-8d9c-430d262aa4fb response_code = 200 uri = /baseboard
27342025-01-08T15:30:06.809ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7745 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = ca5cd6ad-f563-44a4-8773-b93bccb35b7f response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
27352025-01-08T15:30:18.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51222
27362025-01-08T15:30:18.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51222 req_id = 26e461b6-2b9e-4af1-aadf-e35bd20fd254 response_code = 200 uri = /vpc-routes
27372025-01-08T15:30:18.888ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
27382025-01-08T15:30:18.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51222 req_id = 6e22c9f6-d3bd-4d44-880c-a8d2d02c1a0a response_code = 204 uri = /eip-gateways
27392025-01-08T15:30:18.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51415
27402025-01-08T15:30:18.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51415 req_id = ddf36707-de7b-4a25-8079-86943d5c0039 response_code = 200 uri = /vpc-routes
27412025-01-08T15:30:18.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
27422025-01-08T15:30:18.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51415 req_id = cf494ba3-467b-42cf-8558-3d731770da09 response_code = 204 uri = /eip-gateways
27432025-01-08T15:30:18.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51415 req_id = 8f1d62d4-fb19-45ff-bec1-bac904daa3f5 response_code = 204 uri = /vpc-routes
27442025-01-08T15:30:18.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44956
27452025-01-08T15:30:18.972ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27462025-01-08T15:30:19.016ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27472025-01-08T15:30:19.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103679 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44956 req_id = 02ac9078-ba61-4e25-93a5-54fd3915cbfd response_code = 204 uri = /switch-ports
27482025-01-08T15:30:19.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41797
27492025-01-08T15:30:19.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63651
27502025-01-08T15:30:19.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59735
27512025-01-08T15:30:19.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52701
27522025-01-08T15:30:19.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44956 req_id = 11cfbfaa-c7db-45c9-a2fb-f10da4bb2f2f response_code = 200 uri = /network-bootstore-config
27532025-01-08T15:30:19.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 526 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51222 req_id = 82f4daa7-9a67-4f60-ab2d-f76f6ba86ab9 response_code = 204 uri = /vpc-routes
27542025-01-08T15:30:19.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52701 req_id = bc9dad60-4bc0-49e0-8f31-cb52be7259dd response_code = 200 uri = /vpc-routes
27552025-01-08T15:30:19.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41797 req_id = 64b62d14-bc70-4816-95aa-1823ca127b52 response_code = 200 uri = /v2p
27562025-01-08T15:30:19.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27572025-01-08T15:30:19.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63651 req_id = 204572b9-4ace-4a3b-a396-92f30a75957b response_code = 200 uri = /v2p
27582025-01-08T15:30:19.121ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27592025-01-08T15:30:19.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52355
27602025-01-08T15:30:19.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 558 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52355 req_id = 9bd8bb09-0607-457f-9fed-c0b959c86b07 response_code = 200 uri = /v2p
27612025-01-08T15:30:19.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
27622025-01-08T15:30:19.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52701 req_id = 9add199f-2511-46cf-9964-8da2650926eb response_code = 204 uri = /eip-gateways
27632025-01-08T15:30:19.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1036 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52701 req_id = 50dce69e-3c3a-431f-a41e-cbe1a913f1a0 response_code = 204 uri = /vpc-routes
27642025-01-08T15:30:19.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59735 req_id = af73379f-e9fd-48b9-be9c-14d5745eb30f response_code = 204 uri = /switch-ports
27652025-01-08T15:30:19.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59735 req_id = ee07bac6-57c7-4715-a692-dede463040c7 response_code = 200 uri = /network-bootstore-config
27662025-01-08T15:30:19.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55492
27672025-01-08T15:30:19.197ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
27682025-01-08T15:30:19.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
27692025-01-08T15:30:19.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91765 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55492 req_id = 0add3a68-76f2-4b7a-bf74-025d33286245 response_code = 204 uri = /switch-ports
27702025-01-08T15:30:19.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55492 req_id = d541bfc3-5308-4fb6-b65b-a88aba9159d9 response_code = 200 uri = /network-bootstore-config
27712025-01-08T15:30:25.698ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45734
27722025-01-08T15:30:25.699ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45734 req_id = 38222e29-6c4d-4d8b-8ff8-8e492b778704 response_code = 200 uri = /baseboard
27732025-01-08T15:30:36.808ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7667 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = 86acd388-d132-42bd-a3cf-3213b214621e response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14
27742025-01-08T15:30:42.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65115
27752025-01-08T15:30:42.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65115 req_id = 8d6da9d1-2d3e-4640-b2a5-7ebc73614403 response_code = 200 uri = /v2p
27762025-01-08T15:30:42.530ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(5171707) }
27772025-01-08T15:30:42.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1009 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65115 req_id = 6676f3b0-1327-4789-b03a-a0e173ef90e0 response_code = 204 uri = /v2p
27782025-01-08T15:30:42.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57015
27792025-01-08T15:30:42.664ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 4810fedd-8472-4733-b913-e09ac69776fd, kind: Instance { id: cdb2d770-f9ae-4e21-bac2-4439befb7fd1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5171707), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4810fedd-8472-4733-b913-e09ac69776fd, kind: Instance { id: cdb2d770-f9ae-4e21-bac2-4439befb7fd1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5171707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4810fedd-8472-4733-b913-e09ac69776fd, kind: Instance { id: cdb2d770-f9ae-4e21-bac2-4439befb7fd1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5171707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5171707))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4810fedd-8472-4733-b913-e09ac69776fd, kind: Instance { id: cdb2d770-f9ae-4e21-bac2-4439befb7fd1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5171707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 22d760c9-586c-4d35-b62b-b335f9188843, slot: 0, read_only: false, vcr_json: .., name: "disk-9ff6bbccb61" }], boot_settings: Some(InstanceBootSettings { order: [22d760c9-586c-4d35-b62b-b335f9188843] }), cloud_init_bytes: Some(..) } instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 metadata = InstanceMetadata { silo_id: af729a51-87ee-4946-b919-b2c335114c91, project_id: 13498b36-527b-4682-bddc-0c398aa8da2c } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-08T15:30:42.652082695Z }
27802025-01-08T15:30:42.664ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 migration_id = None propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27812025-01-08T15:30:42.664ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 migration_id = None propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 4810fedd-8472-4733-b913-e09ac69776fd, kind: Instance { id: cdb2d770-f9ae-4e21-bac2-4439befb7fd1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5171707), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4810fedd-8472-4733-b913-e09ac69776fd, kind: Instance { id: cdb2d770-f9ae-4e21-bac2-4439befb7fd1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5171707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4810fedd-8472-4733-b913-e09ac69776fd, kind: Instance { id: cdb2d770-f9ae-4e21-bac2-4439befb7fd1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5171707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(5171707))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4810fedd-8472-4733-b913-e09ac69776fd, kind: Instance { id: cdb2d770-f9ae-4e21-bac2-4439befb7fd1 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(5171707), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 22d760c9-586c-4d35-b62b-b335f9188843, slot: 0, read_only: false, vcr_json: .., name: "disk-9ff6bbccb61" }], boot_settings: Some(InstanceBootSettings { order: [22d760c9-586c-4d35-b62b-b335f9188843] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-08T15:30:42.652082695Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27822025-01-08T15:30:42.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10780 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57015 req_id = bcc8b898-b57c-45fa-b538-387bc1604624 response_code = 200 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27832025-01-08T15:30:42.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64058
27842025-01-08T15:30:42.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64058 req_id = 791e2eb8-564d-4856-817f-2ded208f26dc response_code = 200 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd/state
27852025-01-08T15:30:42.762ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 5171707 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27862025-01-08T15:30:42.762ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27872025-01-08T15:30:42.802ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd file = illumos-utils/src/zone.rs:325 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27882025-01-08T15:30:42.826ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd file = illumos-utils/src/zone.rs:363 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27892025-01-08T15:30:42.845ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60206
27902025-01-08T15:30:42.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60206 req_id = e495ffff-b693-40b5-990f-73ac4dcc9a43 response_code = 200 uri = /vpc-routes
27912025-01-08T15:30:42.865ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {4810fedd-8472-4733-b913-e09ac69776fd: {10.151.2.175: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}, 10.151.2.176: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}}} }
27922025-01-08T15:30:44.431ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27932025-01-08T15:30:44.431ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone file = illumos-utils/src/running_zone.rs:488 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27942025-01-08T15:30:44.605ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd") failed: Property not found. retry in 62.641618ms file = illumos-utils/src/svc.rs:36 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27952025-01-08T15:30:44.680ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd") failed: Property not found. retry in 137.946116ms file = illumos-utils/src/svc.rs:36 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27962025-01-08T15:30:44.844ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd") failed: Property not found. retry in 181.660778ms file = illumos-utils/src/svc.rs:36 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27972025-01-08T15:30:45.040ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd") failed: Property not found. retry in 393.370725ms file = illumos-utils/src/svc.rs:36 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27982025-01-08T15:30:45.449ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd") failed: Property not found. retry in 818.417782ms file = illumos-utils/src/svc.rs:36 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
27992025-01-08T15:30:46.279ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd") failed: Property not found. retry in 792.35635ms file = illumos-utils/src/svc.rs:36 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28002025-01-08T15:30:47.083ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd") failed: Property not found. retry in 812.775979ms file = illumos-utils/src/svc.rs:36 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28012025-01-08T15:30:47.906ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd") failed: Property not found. retry in 956.688845ms file = illumos-utils/src/svc.rs:36 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28022025-01-08T15:30:48.874ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd") failed: Property not found. retry in 1.440938922s file = illumos-utils/src/svc.rs:36 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd zone = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28032025-01-08T15:30:48.881ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34139
28042025-01-08T15:30:48.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56682
28052025-01-08T15:30:48.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56682 req_id = b8d0ad7b-3ca5-4ed2-8f7d-5d87e812a088 response_code = 200 uri = /vpc-routes
28062025-01-08T15:30:48.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {4810fedd-8472-4733-b913-e09ac69776fd: {10.151.2.175: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}, 10.151.2.176: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}}} }
28072025-01-08T15:30:48.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56682 req_id = 1fcf19bc-8874-4dd9-95c5-db54690041b5 response_code = 204 uri = /eip-gateways
28082025-01-08T15:30:49.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62391
28092025-01-08T15:30:49.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1043 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56682 req_id = d3e1e892-9a88-4704-8025-622b34c3a805 response_code = 204 uri = /vpc-routes
28102025-01-08T15:30:49.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61379
28112025-01-08T15:30:49.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61379 req_id = 579f1673-bd30-4bde-a143-c9f8352acfc3 response_code = 200 uri = /v2p
28122025-01-08T15:30:49.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54571
28132025-01-08T15:30:49.205ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28142025-01-08T15:30:49.244ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28152025-01-08T15:30:49.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98777 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54571 req_id = 3f2b7aff-641e-4034-b1a3-3a0f3b8becbe response_code = 204 uri = /switch-ports
28162025-01-08T15:30:49.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54669
28172025-01-08T15:30:49.304ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44527
28182025-01-08T15:30:49.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 374 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54571 req_id = d553276d-f8b9-4031-a103-70ba7448f45f response_code = 200 uri = /network-bootstore-config
28192025-01-08T15:30:49.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54669 req_id = 5c7c4b04-7904-496a-a8f6-cec96c10b4da response_code = 200 uri = /v2p
28202025-01-08T15:30:49.304ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28212025-01-08T15:30:49.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51465
28222025-01-08T15:30:49.348ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28232025-01-08T15:30:49.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44527 req_id = b7d80bb8-5575-4b1c-9e37-9812e6b1a051 response_code = 204 uri = /switch-ports
28242025-01-08T15:30:49.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44527 req_id = 96b89693-70e2-4718-a912-6f368e3c9bda response_code = 200 uri = /network-bootstore-config
28252025-01-08T15:30:49.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52339
28262025-01-08T15:30:49.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52339 req_id = 636f20e7-622f-4403-98f7-ba3222e0c505 response_code = 200 uri = /vpc-routes
28272025-01-08T15:30:49.577ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {4810fedd-8472-4733-b913-e09ac69776fd: {10.151.2.176: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}, 10.151.2.175: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}}} }
28282025-01-08T15:30:49.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52339 req_id = 733bff7a-0970-4b74-b7c6-b2dd147d0661 response_code = 204 uri = /eip-gateways
28292025-01-08T15:30:49.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45274
28302025-01-08T15:30:49.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45274 req_id = 0205ea90-c6f8-4646-8f9f-da08834ef12f response_code = 200 uri = /v2p
28312025-01-08T15:30:49.620ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34966
28322025-01-08T15:30:49.620ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
28332025-01-08T15:30:49.661ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
28342025-01-08T15:30:49.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98343 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34966 req_id = 915fac2d-c8e9-40b7-a658-f35c0646bb73 response_code = 204 uri = /switch-ports
28352025-01-08T15:30:49.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52339 req_id = 524e742e-8a4c-4623-bce0-9138679b376e response_code = 204 uri = /vpc-routes
28362025-01-08T15:30:49.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34966 req_id = e5d7897d-5213-40af-92ed-e10739f85a8d response_code = 200 uri = /network-bootstore-config
28372025-01-08T15:30:50.341ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd file = sled-agent/src/instance.rs:2067 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28382025-01-08T15:30:50.351ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28392025-01-08T15:30:50.390ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28402025-01-08T15:30:50.529ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28412025-01-08T15:30:50.530ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
28422025-01-08T15:30:50.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1203852 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51465 req_id = 307d0b14-0731-4925-ab65-741b59849abe response_code = 200 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd/state
28432025-01-08T15:30:50.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1649154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34139 req_id = d97263d0-77bc-4718-beb6-f38145fa14e3 response_code = 200 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd/state
28442025-01-08T15:30:50.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1413526 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62391 req_id = 2bdc207c-c421-4ca3-a830-931dc8285643 response_code = 200 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd/state
28452025-01-08T15:30:50.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7667685 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60206 req_id = 8f3ce44f-9bce-4b3e-a9e0-503e68a183dd response_code = 204 uri = /eip-gateways
28462025-01-08T15:30:50.531ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-08T15:30:50.530558765Z } file = sled-agent/src/instance.rs:780 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28472025-01-08T15:30:50.531ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-08T15:30:50.530558765Z } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28482025-01-08T15:30:50.531ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-08T15:30:50.530558765Z }, migration_in: None, migration_out: None }
28492025-01-08T15:30:50.573ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-08T15:30:50.573125998Z } file = sled-agent/src/instance.rs:780 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28502025-01-08T15:30:50.573ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-08T15:30:50.573125998Z } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28512025-01-08T15:30:50.573ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-08T15:30:50.573125998Z }, migration_in: None, migration_out: None }
28522025-01-08T15:30:50.605ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: d025d49a-6fea-4343-8957-b5888a4c1e27, version: 3 } old_vers = RouterVersion { router_id: d025d49a-6fea-4343-8957-b5888a4c1e27, version: 3 } subnet = RouterId { vni: Vni(5171707), kind: System }
28532025-01-08T15:30:50.605ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60206 req_id = 2363ed4a-4d0e-45dd-8d71-5011a8b0939d response_code = 204 uri = /vpc-routes
28542025-01-08T15:30:50.647ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35025
28552025-01-08T15:30:50.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35025 req_id = 8b74c64e-892f-41b9-9839-3a1407af4284 response_code = 200 uri = /vpc-routes
28562025-01-08T15:30:50.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {4810fedd-8472-4733-b913-e09ac69776fd: {10.151.2.175: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}, 10.151.2.176: {0b211a7f-fef5-41da-96d2-9f2da8bef5f5}}} }
28572025-01-08T15:30:50.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35025 req_id = df7660b8-1cc3-4bcf-8c4d-d2f7ac649a4f response_code = 204 uri = /eip-gateways
28582025-01-08T15:30:50.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35025 req_id = 841f1960-4f1a-44d2-ae7b-f5251d44771c response_code = 204 uri = /vpc-routes
28592025-01-08T15:30:55.735ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:33454
28602025-01-08T15:30:55.735ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:33454 req_id = 871a16e8-eb41-4939-b3f7-7a042c9171c1 response_code = 200 uri = /baseboard
28612025-01-08T15:31:00.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33992
28622025-01-08T15:31:00.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 641 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33992 req_id = c2c4f952-34e7-46a2-9dac-a0aeff15cb9c response_code = 200 uri = /vmms/d1c7ca53-31be-4a7e-8070-174ba6c8d6fd/state
28632025-01-08T15:31:00.248ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-08T15:31:00.248575648Z } file = sled-agent/src/instance.rs:780 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28642025-01-08T15:31:00.248ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-08T15:31:00.248575648Z } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28652025-01-08T15:31:00.248ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-08T15:31:00.248575648Z }, migration_in: None, migration_out: None }
28662025-01-08T15:31:00.286ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-08T15:31:00.286959512Z } file = sled-agent/src/instance.rs:780 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28672025-01-08T15:31:00.287ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-08T15:31:00.286959512Z } propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28682025-01-08T15:31:00.287ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28692025-01-08T15:31:00.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28702025-01-08T15:31:00.287ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28712025-01-08T15:31:00.287ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/55d7aa21-4593-4ac1-8ba2-7e6c0f6021ae/debug/bundle/zone", "/pool/int/580ac96a-ea6a-49c2-9023-080ed7bbaec9/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/2bc669d0-0094-4137-bc22-36487a33d705/crypt/debug", "/pool/ext/b68c2a96-30ec-49d6-a55f-078a6befe678/crypt/debug", "/pool/ext/287fc1e8-f92d-41d2-96e3-902b3e7ba0f9/crypt/debug", "/pool/ext/2838adfd-6724-4d11-9727-968f07762cf0/crypt/debug", "/pool/ext/f80f84fb-0d35-46c9-a329-b7397a036f55/crypt/debug", "/pool/ext/04d48b1d-c030-493d-84a2-8ba81e39ea46/crypt/debug", "/pool/ext/f4cfa29b-4024-4c00-b4a6-155ff6b9ea60/crypt/debug", "/pool/ext/8a1cc0dc-cf41-4fe3-a047-63d0e7a0fbae/crypt/debug", "/pool/ext/f3346ff5-16b1-43c2-a321-ba0fe5b4302a/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28722025-01-08T15:31:00.908ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd", bundle_id: 5d94e9d9-b4af-4ba0-9a60-8120b7f221f0 }, time_created: 2025-01-08T15:31:00.288205130Z, version: 0, cause: TerminatedInstance }
28732025-01-08T15:31:00.908ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_d1c7ca53-31be-4a7e-8070-174ba6c8d6fd file = sled-agent/src/instance.rs:1313 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28742025-01-08T15:31:02.674ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28752025-01-08T15:31:02.692ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(5171707), kind: System }
28762025-01-08T15:31:02.692ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(5171707), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28772025-01-08T15:31:02.693ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-08T15:31:02.693033458Z }, migration_in: None, migration_out: None }
28782025-01-08T15:31:02.721ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-08T15:31:02.693033458Z }, migration_in: None, migration_out: None }
28792025-01-08T15:31:02.725ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = cdb2d770-f9ae-4e21-bac2-4439befb7fd1 propolis_id = d1c7ca53-31be-4a7e-8070-174ba6c8d6fd
28802025-01-08T15:31:03.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36941
28812025-01-08T15:31:03.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36941 req_id = a37ded20-22e2-4aca-8b49-6fa5a5ae1626 response_code = 200 uri = /vpc-routes
28822025-01-08T15:31:03.359ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
28832025-01-08T15:31:03.360ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14
28842025-01-08T15:31:03.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36941 req_id = bf473459-6ec7-4236-a8e9-205771b13d71 response_code = 204 uri = /eip-gateways
28852025-01-08T15:31:03.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36941 req_id = 28424381-f15d-4c87-b931-336cbf7a0c29 response_code = 204 uri = /vpc-routes
28862025-01-08T15:31:03.443ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34720
28872025-01-08T15:31:03.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34720 req_id = 795b0dc8-46af-4c93-8895-b4d5147680be response_code = 200 uri = /v2p
28882025-01-08T15:31:04.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34267
28892025-01-08T15:31:04.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34267 req_id = 8be5d32e-c64d-41f2-8d41-28d4455a55c1 response_code = 200 uri = /v2p
28902025-01-08T15:31:04.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40341
28912025-01-08T15:31:04.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40341 req_id = 1121f62d-2f2e-406a-8404-93088c74f77f response_code = 200 uri = /vpc-routes
28922025-01-08T15:31:05.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
28932025-01-08T15:31:05.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40341 req_id = c2468cd2-1afa-4788-a342-f5d443cd3822 response_code = 204 uri = /eip-gateways
28942025-01-08T15:31:05.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40341 req_id = 7ca7d55e-87e5-4b00-8a19-3eef0ed5042f response_code = 204 uri = /vpc-routes
28952025-01-08T15:31:05.614ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52962
28962025-01-08T15:31:05.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52962 req_id = ea638052-2776-4f8b-b9e1-6d532e9d94d7 response_code = 200 uri = /vpc-routes
28972025-01-08T15:31:05.627ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 values = ExternalIpGatewayMap { mappings: {} }
28982025-01-08T15:31:05.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52962 req_id = 32b1be43-1a14-46ba-a841-fae40a2f53bf response_code = 204 uri = /eip-gateways
28992025-01-08T15:31:05.634ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52962 req_id = c644e141-034c-4dff-8a6f-513f88f09d50 response_code = 204 uri = /vpc-routes
29002025-01-08T15:31:06.809ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7790 local_addr = [fd00:1122:3344:101::1]:57921 method = GET remote_addr = [fd00:1122:3344:101::d]:53656 req_id = e806f415-ec83-4116-b7de-4220df3c9dbb response_code = 200 sled_id = ba54f0e2-bde0-4da7-a58e-566dc5903c14 uri = /ba54f0e2-bde0-4da7-a58e-566dc5903c14