Max level shown:
1 [ Jan 28 23:03:47 Enabled. ]
2 [ Jan 28 23:03:47 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 28 23:03:47 Method "start" exited with status 0. ]
4 [ Jan 28 23:03:47 Rereading configuration. ]
5 [ Jan 28 23:03:47 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-28T23:03:47.631ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-28T23:03:47.632ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-28T23:03:47.686ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-28T23:03:47.686ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-28T23:03:47.802ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-28T23:03:47.812ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-28T23:03:47.819ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-28T23:03:48.423ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-01-28T23:03:48.561ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-28T23:03:48.561ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-28T23:03:48.561ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-28T23:03:48.561ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-28T23:03:48.561ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-01-28T23:03:48.561ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-01-28T23:03:48.564ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-28T23:03:48.564ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-28T23:03:48.564ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-28T23:03:48.564ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-28T23:03:48.564ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-28T23:03:48.564ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-28T23:03:48.564ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-28T23:03:48.564ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-28T23:03:48.564ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-28T23:03:48.576ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-28T23:03:48.576ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool)
322025-01-28T23:03:48.675ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal }
332025-01-28T23:03:49.033ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-28T23:03:49.033ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-28T23:03:49.033ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-28T23:03:49.033ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-28T23:03:49.033ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-28T23:03:49.033ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-28T23:03:49.033ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-28T23:03:49.042ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-28T23:03:49.042ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool)
422025-01-28T23:03:49.131ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal }
432025-01-28T23:03:49.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-28T23:03:49.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-28T23:03:49.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
462025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
472025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482025-01-28T23:03:49.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-28T23:03:49.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
502025-01-28T23:03:49.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
512025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-28T23:03:49.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-28T23:03:49.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-28T23:03:49.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-28T23:03:49.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-28T23:03:49.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-28T23:03:49.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-28T23:03:49.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-28T23:03:49.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-28T23:03:49.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
642025-01-28T23:03:49.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672025-01-28T23:03:49.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-28T23:03:49.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-28T23:03:49.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
702025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
712025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
722025-01-28T23:03:49.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-28T23:03:49.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-28T23:03:49.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-28T23:03:49.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-28T23:03:49.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-28T23:03:49.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-28T23:03:49.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
812025-01-28T23:03:49.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
822025-01-28T23:03:49.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
832025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-01-28T23:03:49.495ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-01-28T23:03:49.495ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-28T23:03:49.495ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-28T23:03:49.495ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-28T23:03:49.495ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-28T23:03:49.496ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-28T23:03:49.496ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-28T23:03:49.496ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-28T23:03:49.496ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-01-28T23:03:49.496ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
942025-01-28T23:03:49.496ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
952025-01-28T23:03:49.496ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
962025-01-28T23:03:49.496ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
972025-01-28T23:03:49.496ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-28T23:03:49.496ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-28T23:03:49.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002025-01-28T23:03:49.496ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-01-28T23:03:49.496ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-01-28T23:03:49.496ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-01-28T23:03:49.496ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-28T23:03:49.496ZINFOSledAgent (bootstore): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-01-28T23:03:49.496ZINFOSledAgent (bootstore): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-01-28T23:03:49.496ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-01-28T23:03:49.496ZINFOSledAgent (bootstore): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-01-28T23:03:49.496ZINFOSledAgent (bootstore): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-01-28T23:03:49.496ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-01-28T23:03:49.496ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-28T23:03:49.496ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-28T23:03:49.507ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-28T23:03:49.507ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1130, tv_nsec: 363052489 } time_to_next_cleanup = 599.999944819s
1142025-01-28T23:03:49.507ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-28T23:03:49.507ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-28T23:03:49.509ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-28T23:03:49.510ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-28T23:03:49.510ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-01-28T23:03:49.512ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-01-28T23:03:49.512ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1195
1212025-01-28T23:03:49.512ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-28T23:03:49.512ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-28T23:03:49.512ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-28T23:03:49.512ZINFOSledAgent (RSS): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-28T23:03:49.512ZINFOSledAgent (RSS): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-28T23:03:49.512ZINFOSledAgent (RSS): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-28T23:03:49.512ZINFOSledAgent (RSS): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-28T23:03:49.512ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1244
1292025-01-28T23:03:49.512ZINFOSledAgent (RSS): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-28T23:03:49.513ZINFOSledAgent (RSS): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-28T23:03:49.513ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1276
1322025-01-28T23:03:49.513ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-28T23:03:49.513ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-28T23:03:49.513ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1307
1352025-01-28T23:03:49.513ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-01-28T23:03:49.513ZINFOSledAgent (bootstore): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-01-28T23:03:49.513ZINFOSledAgent (bootstore): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-01-28T23:03:49.513ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-01-28T23:03:49.513ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 333ba0f0-e056-439e-a4d5-a88dac7ac1cc (sled), rack_id: 1dd1bac0-1736-4ceb-85ab-0435e21b8ce6, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-01-28T23:03:49.514ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-28T23:03:49.514ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-28T23:03:49.518ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-28T23:03:49.524ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-28T23:03:49.524ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-28T23:03:49.528ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-28T23:03:49.528ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-28T23:03:49.528ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:59619
1482025-01-28T23:03:49.529ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 333ba0f0-e056-439e-a4d5-a88dac7ac1cc (sled), rack_id: 1dd1bac0-1736-4ceb-85ab-0435e21b8ce6, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-28T23:03:49.529ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-28T23:03:49.529ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-28T23:03:49.529ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-28T23:03:49.529ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-28T23:03:49.529ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-28T23:03:49.529ZINFOSledAgent (StorageManager): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-28T23:03:49.529ZINFOSledAgent (StorageManager): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-28T23:03:49.529ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1572025-01-28T23:03:49.529ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1582025-01-28T23:03:49.529ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1592025-01-28T23:03:49.529ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1602025-01-28T23:03:49.529ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-28T23:03:49.529ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-28T23:03:49.545ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-28T23:03:49.566ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-28T23:03:49.583ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-28T23:03:49.590ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
1662025-01-28T23:03:49.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-28T23:03:49.590ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
1682025-01-28T23:03:49.590ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-28T23:03:49.593ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 114.66723ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4fe8a1b9-9b73-40d8-ba04-7760e54fdb31", "content-length": "124", "date": "Tue, 28 Jan 2025 23:03:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4fe8a1b9-9b73-40d8-ba04-7760e54fdb31" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-28T23:03:49.602ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_14e0b5aa-661f-4c33-a465-6bdb69d0de3c/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-28T23:03:49.625ZINFOSledAgent: successfully created encrypted zvol: name="oxi_14e0b5aa-661f-4c33-a465-6bdb69d0de3c/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-28T23:03:49.625ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_14e0b5aa-661f-4c33-a465-6bdb69d0de3c/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-28T23:03:49.630ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
1742025-01-28T23:03:49.630ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-28T23:03:49.630ZINFOSledAgent (BackingFs): Ensuring dataset oxi_14e0b5aa-661f-4c33-a465-6bdb69d0de3c/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-28T23:03:49.699ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1772025-01-28T23:03:49.709ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1782025-01-28T23:03:49.710ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 90.486958ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3477df96-ddad-4980-8c00-ca1904799989", "content-length": "124", "date": "Tue, 28 Jan 2025 23:03:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3477df96-ddad-4980-8c00-ca1904799989" } file = clients/ddm-admin-client/src/lib.rs:177
1792025-01-28T23:03:49.802ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-28T23:03:49.802ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 187.148841ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "353733f9-cba4-4d9a-90f5-8664a000b897", "content-length": "124", "date": "Tue, 28 Jan 2025 23:03:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "353733f9-cba4-4d9a-90f5-8664a000b897" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-28T23:03:49.923ZINFOSledAgent (BackingFs): Mounting oxi_14e0b5aa-661f-4c33-a465-6bdb69d0de3c/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-28T23:03:49.936ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-28T23:03:49.936ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-28T23:03:49.936ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-28T23:03:49.936ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-28T23:03:49.991ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-28T23:03:49.992ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 94.261133ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e0660885-57f8-42c6-b448-2d51dcabb4b4", "content-length": "124", "date": "Tue, 28 Jan 2025 23:03:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e0660885-57f8-42c6-b448-2d51dcabb4b4" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-28T23:03:50.087ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-28T23:03:50.087ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 286.305172ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0667413b-cad5-4b84-8033-a2276ab91a29", "content-length": "124", "date": "Tue, 28 Jan 2025 23:03:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0667413b-cad5-4b84-8033-a2276ab91a29" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-28T23:03:50.375ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-28T23:03:50.376ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 286.301184ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0a047703-e176-4519-b189-cd638a5043e0", "content-length": "124", "date": "Tue, 28 Jan 2025 23:03:49 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0a047703-e176-4519-b189-cd638a5043e0" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-28T23:03:50.663ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-28T23:03:50.677ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
1942025-01-28T23:03:50.682ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:42102 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
1952025-01-28T23:03:50.682ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
1962025-01-28T23:03:50.682ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:42102 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
1972025-01-28T23:03:50.683ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 323.125927ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
1982025-01-28T23:03:50.684ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
1992025-01-28T23:03:50.684ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2002025-01-28T23:03:50.684ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2012025-01-28T23:03:50.684ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2022025-01-28T23:03:51.009ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 616.778683ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2032025-01-28T23:03:51.627ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 784.934127ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2042025-01-28T23:03:52.414ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.560576829s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2052025-01-28T23:03:53.295ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2062025-01-28T23:03:53.295ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2072025-01-28T23:03:53.295ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2082025-01-28T23:03:53.295ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2092025-01-28T23:03:53.295ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2102025-01-28T23:03:53.295ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2112025-01-28T23:03:53.296ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2122025-01-28T23:03:53.298ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2132025-01-28T23:03:53.298ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='b27a6ac2-ff05-458d-b1c5-3251579d1041'/> <propval type="astring" name="rack_id" value='1dd1bac0-1736-4ceb-85ab-0435e21b8ce6'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe71:8d60'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='1dd1bac0-1736-4ceb-85ab-0435e21b8ce6'/> <propval type="astring" name="sled_id" value='333ba0f0-e056-439e-a4d5-a88dac7ac1cc'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='333ba0f0-e056-439e-a4d5-a88dac7ac1cc'/> <propval type="astring" name="rack_uuid" value='1dd1bac0-1736-4ceb-85ab-0435e21b8ce6'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='333ba0f0-e056-439e-a4d5-a88dac7ac1cc'/> <propval type="astring" name="rack_uuid" value='1dd1bac0-1736-4ceb-85ab-0435e21b8ce6'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-01-28T23:03:53.298ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152025-01-28T23:03:53.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 48.067658ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-01-28T23:03:53.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 88.127383ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-01-28T23:03:54.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 200.195198ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-28T23:03:54.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 487.549698ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-28T23:03:54.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.169980188s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2202025-01-28T23:03:54.976ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.69750673s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2212025-01-28T23:03:55.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.152102729s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-28T23:03:57.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 774.664001ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-01-28T23:03:58.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.20678337s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-01-28T23:03:59.875ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/333ba0f0-e056-439e-a4d5-a88dac7ac1cc) file = sled-agent/src/nexus.rs:527 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2252025-01-28T23:03:59.905ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2262025-01-28T23:03:59.905ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2272025-01-28T23:03:59.907ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2282025-01-28T23:03:59.907ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2292025-01-28T23:03:59.907ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2302025-01-28T23:03:59.907ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2312025-01-28T23:03:59.907ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2322025-01-28T23:03:59.907ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2332025-01-28T23:03:59.907ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2342025-01-28T23:03:59.907ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2352025-01-28T23:03:59.907ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:59619
2362025-01-28T23:04:00.106ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2372025-01-28T23:04:00.106ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2382025-01-28T23:04:00.111ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2392025-01-28T23:04:00.111ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2402025-01-28T23:04:00.111ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2412025-01-28T23:04:00.408ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57502
2422025-01-28T23:04:00.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2432025-01-28T23:04:00.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2442025-01-28T23:04:00.409ZINFOSledAgent (ServiceManager): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:188
2452025-01-28T23:04:00.409ZINFOSledAgent (ServiceManager): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:188
2462025-01-28T23:04:00.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57502 req_id = 5a44153a-2309-4452-aa45-86fbed7d8264 response_code = 200 uri = /inventory
2472025-01-28T23:04:00.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41397
2482025-01-28T23:04:00.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41397 req_id = 61cceb32-b96c-4128-93dc-13645310b41d response_code = 200 uri = /sled-role
2492025-01-28T23:04:00.470ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 11d86aee-c870-43e7-92ef-7dd3ffb73fc5 (physical_disk), pool_id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 291254f8-2fa7-4bf5-b8c0-d7cff849c040 (physical_disk), pool_id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 5b33b2ba-4e08-4738-9e95-fb6e4fb8f7d8 (physical_disk), pool_id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 64c08371-3aa7-4ff3-bbd0-6b12ff565a8d (physical_disk), pool_id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7d2d8b74-7d2f-4702-b21b-168107c98cd2 (physical_disk), pool_id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8b252e90-b288-422c-8e81-5b6fcc8f2f5a (physical_disk), pool_id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: c2e6609f-6b43-43ad-8cc5-092198e0c3b4 (physical_disk), pool_id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: d9b71ba0-4f1e-4bba-b3b0-0b2da3c6ffac (physical_disk), pool_id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: e8493761-5c5d-4b96-82c2-5d637e5bd7a5 (physical_disk), pool_id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2502025-01-28T23:04:00.471ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52393
2512025-01-28T23:04:00.471ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2522025-01-28T23:04:00.471ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 11d86aee-c870-43e7-92ef-7dd3ffb73fc5 (physical_disk), pool_id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 291254f8-2fa7-4bf5-b8c0-d7cff849c040 (physical_disk), pool_id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 5b33b2ba-4e08-4738-9e95-fb6e4fb8f7d8 (physical_disk), pool_id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 64c08371-3aa7-4ff3-bbd0-6b12ff565a8d (physical_disk), pool_id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7d2d8b74-7d2f-4702-b21b-168107c98cd2 (physical_disk), pool_id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 8b252e90-b288-422c-8e81-5b6fcc8f2f5a (physical_disk), pool_id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: c2e6609f-6b43-43ad-8cc5-092198e0c3b4 (physical_disk), pool_id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: d9b71ba0-4f1e-4bba-b3b0-0b2da3c6ffac (physical_disk), pool_id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: e8493761-5c5d-4b96-82c2-5d637e5bd7a5 (physical_disk), pool_id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2532025-01-28T23:04:00.471ZINFOSledAgent (StorageManager): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2542025-01-28T23:04:00.471ZINFOSledAgent (StorageManager): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2552025-01-28T23:04:00.471ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2562025-01-28T23:04:00.471ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2572025-01-28T23:04:00.471ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2582025-01-28T23:04:00.471ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2592025-01-28T23:04:00.471ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2602025-01-28T23:04:00.621ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2612025-01-28T23:04:00.621ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool)
2622025-01-28T23:04:00.857ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.95574153s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2632025-01-28T23:04:00.857ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 251898852608411906 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2642025-01-28T23:04:00.858ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10512205622993224981 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2652025-01-28T23:04:01.082ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/333ba0f0-e056-439e-a4d5-a88dac7ac1cc) file = sled-agent/src/probe_manager.rs:231 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2662025-01-28T23:04:01.317ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
2672025-01-28T23:04:01.365ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }
2682025-01-28T23:04:01.373ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2692025-01-28T23:04:01.373ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2702025-01-28T23:04:01.373ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2712025-01-28T23:04:01.373ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2722025-01-28T23:04:01.373ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-01-28T23:04:01.373ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2742025-01-28T23:04:01.373ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2752025-01-28T23:04:01.409ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2762025-01-28T23:04:01.416ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/zone file = sled-storage/src/dataset.rs:302
2772025-01-28T23:04:01.548ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_68044c5c-97c7-414c-b44a-b8251f523a8f file = sled-storage/src/dataset.rs:388
2782025-01-28T23:04:01.555ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2792025-01-28T23:04:01.555ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2802025-01-28T23:04:01.555ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2812025-01-28T23:04:01.555ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2822025-01-28T23:04:01.555ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2832025-01-28T23:04:01.565ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2842025-01-28T23:04:01.565ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool)
2852025-01-28T23:04:01.658ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }
2862025-01-28T23:04:01.666ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2872025-01-28T23:04:01.666ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2882025-01-28T23:04:01.666ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2892025-01-28T23:04:01.666ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2902025-01-28T23:04:01.666ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-01-28T23:04:01.666ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2922025-01-28T23:04:01.666ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2932025-01-28T23:04:01.703ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2942025-01-28T23:04:01.711ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_099773d5-5f69-4f65-8f86-75c48d557e90/crypt/zone file = sled-storage/src/dataset.rs:302
2952025-01-28T23:04:01.851ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_099773d5-5f69-4f65-8f86-75c48d557e90 file = sled-storage/src/dataset.rs:388
2962025-01-28T23:04:01.859ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972025-01-28T23:04:01.859ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982025-01-28T23:04:01.859ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992025-01-28T23:04:01.859ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002025-01-28T23:04:01.859ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012025-01-28T23:04:01.869ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022025-01-28T23:04:01.869ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool)
3032025-01-28T23:04:01.962ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }
3042025-01-28T23:04:01.970ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052025-01-28T23:04:01.970ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062025-01-28T23:04:01.970ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072025-01-28T23:04:01.970ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082025-01-28T23:04:01.970ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-01-28T23:04:01.970ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-01-28T23:04:01.970ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112025-01-28T23:04:02.004ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122025-01-28T23:04:02.012ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/zone file = sled-storage/src/dataset.rs:302
3132025-01-28T23:04:02.085ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/333ba0f0-e056-439e-a4d5-a88dac7ac1cc) file = sled-agent/src/probe_manager.rs:231 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
3142025-01-28T23:04:02.152ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 file = sled-storage/src/dataset.rs:388
3152025-01-28T23:04:02.160ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3162025-01-28T23:04:02.160ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3172025-01-28T23:04:02.160ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3182025-01-28T23:04:02.160ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3192025-01-28T23:04:02.160ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3202025-01-28T23:04:02.170ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3212025-01-28T23:04:02.170ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool)
3222025-01-28T23:04:02.265ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }
3232025-01-28T23:04:02.273ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3242025-01-28T23:04:02.273ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3252025-01-28T23:04:02.273ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3262025-01-28T23:04:02.273ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3272025-01-28T23:04:02.273ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-01-28T23:04:02.273ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3292025-01-28T23:04:02.273ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3302025-01-28T23:04:02.308ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3312025-01-28T23:04:02.315ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone file = sled-storage/src/dataset.rs:302
3322025-01-28T23:04:02.453ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 file = sled-storage/src/dataset.rs:388
3332025-01-28T23:04:02.461ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3342025-01-28T23:04:02.461ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3352025-01-28T23:04:02.461ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3362025-01-28T23:04:02.461ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3372025-01-28T23:04:02.461ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3382025-01-28T23:04:02.470ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3392025-01-28T23:04:02.470ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool)
3402025-01-28T23:04:02.564ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }
3412025-01-28T23:04:02.572ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3422025-01-28T23:04:02.572ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3432025-01-28T23:04:02.572ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3442025-01-28T23:04:02.572ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3452025-01-28T23:04:02.572ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-01-28T23:04:02.572ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3472025-01-28T23:04:02.572ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3482025-01-28T23:04:02.607ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3492025-01-28T23:04:02.615ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/zone file = sled-storage/src/dataset.rs:302
3502025-01-28T23:04:02.753ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_21294dfd-a58f-42c6-a41c-8b148c95a198 file = sled-storage/src/dataset.rs:388
3512025-01-28T23:04:02.762ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522025-01-28T23:04:02.762ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532025-01-28T23:04:02.762ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542025-01-28T23:04:02.762ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552025-01-28T23:04:02.762ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562025-01-28T23:04:02.771ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572025-01-28T23:04:02.771ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool)
3582025-01-28T23:04:02.862ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }
3592025-01-28T23:04:02.869ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602025-01-28T23:04:02.869ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612025-01-28T23:04:02.869ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622025-01-28T23:04:02.869ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632025-01-28T23:04:02.869ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-01-28T23:04:02.869ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-01-28T23:04:02.869ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662025-01-28T23:04:02.901ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672025-01-28T23:04:02.909ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/zone file = sled-storage/src/dataset.rs:302
3682025-01-28T23:04:03.050ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_ff6949fe-2851-437a-b6e9-cb91f2325920 file = sled-storage/src/dataset.rs:388
3692025-01-28T23:04:03.058ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702025-01-28T23:04:03.058ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712025-01-28T23:04:03.058ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722025-01-28T23:04:03.058ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732025-01-28T23:04:03.058ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742025-01-28T23:04:03.068ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752025-01-28T23:04:03.068ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool)
3762025-01-28T23:04:03.168ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }
3772025-01-28T23:04:03.176ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782025-01-28T23:04:03.176ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792025-01-28T23:04:03.176ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802025-01-28T23:04:03.176ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812025-01-28T23:04:03.176ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-01-28T23:04:03.176ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-01-28T23:04:03.176ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842025-01-28T23:04:03.180ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/333ba0f0-e056-439e-a4d5-a88dac7ac1cc) file = sled-agent/src/probe_manager.rs:231 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
3852025-01-28T23:04:03.212ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3862025-01-28T23:04:03.220ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone file = sled-storage/src/dataset.rs:302
3872025-01-28T23:04:03.359ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_46e85043-614f-4a55-8660-1ccd892d22b2 file = sled-storage/src/dataset.rs:388
3882025-01-28T23:04:03.367ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3892025-01-28T23:04:03.367ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3902025-01-28T23:04:03.367ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3912025-01-28T23:04:03.367ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3922025-01-28T23:04:03.367ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3932025-01-28T23:04:03.377ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3942025-01-28T23:04:03.377ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool)
3952025-01-28T23:04:03.472ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }
3962025-01-28T23:04:03.480ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3972025-01-28T23:04:03.480ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3982025-01-28T23:04:03.480ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3992025-01-28T23:04:03.480ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4002025-01-28T23:04:03.480ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-01-28T23:04:03.480ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4022025-01-28T23:04:03.480ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4032025-01-28T23:04:03.514ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4042025-01-28T23:04:03.522ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b6f4a7de-ae5d-4497-bee3-21826d504667/crypt/zone file = sled-storage/src/dataset.rs:302
4052025-01-28T23:04:03.668ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b6f4a7de-ae5d-4497-bee3-21826d504667 file = sled-storage/src/dataset.rs:388
4062025-01-28T23:04:03.676ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4072025-01-28T23:04:03.676ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4082025-01-28T23:04:03.676ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4092025-01-28T23:04:03.676ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4102025-01-28T23:04:03.676ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4112025-01-28T23:04:03.686ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4122025-01-28T23:04:03.686ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool)
4132025-01-28T23:04:03.787ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }
4142025-01-28T23:04:03.795ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4152025-01-28T23:04:03.795ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4162025-01-28T23:04:03.795ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4172025-01-28T23:04:03.795ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4182025-01-28T23:04:03.795ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-01-28T23:04:03.795ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4202025-01-28T23:04:03.795ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4212025-01-28T23:04:03.829ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222025-01-28T23:04:03.836ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/zone file = sled-storage/src/dataset.rs:302
4232025-01-28T23:04:03.978ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_79dc877f-201a-4a6a-a185-dc64a57ed603 file = sled-storage/src/dataset.rs:388
4242025-01-28T23:04:03.986ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252025-01-28T23:04:03.986ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262025-01-28T23:04:03.986ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272025-01-28T23:04:03.987ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 14e0b5aa-661f-4c33-a465-6bdb69d0de3c (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 500578dd-aed8-4d17-9960-3dae0d997cc1 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282025-01-28T23:04:03.987ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292025-01-28T23:04:03.987ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302025-01-28T23:04:03.987ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-01-28T23:04:03.987ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
4322025-01-28T23:04:03.987ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4332025-01-28T23:04:03.987ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
4342025-01-28T23:04:03.987ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
4352025-01-28T23:04:03.987ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
4362025-01-28T23:04:03.987ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
4372025-01-28T23:04:03.987ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
4382025-01-28T23:04:03.987ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392025-01-28T23:04:03.987ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
4402025-01-28T23:04:03.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3516501 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52393 req_id = 0ef21fe5-8b22-4cd6-aff1-1f007c93746e response_code = 200 uri = /omicron-physical-disks
4412025-01-28T23:04:04.019ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00a4b560-9e50-4260-b2e3-bfe52276f1e2 (dataset): DatasetConfig { id: 00a4b560-9e50-4260-b2e3-bfe52276f1e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 01e9f300-60f1-41f1-bc89-0f80c98da01c (dataset): DatasetConfig { id: 01e9f300-60f1-41f1-bc89-0f80c98da01c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0422cbf0-4e76-4d43-93b4-412fe1fa2568 (dataset): DatasetConfig { id: 0422cbf0-4e76-4d43-93b4-412fe1fa2568 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0616c314-bcca-47a8-b973-5a46970d62c8 (dataset): DatasetConfig { id: 0616c314-bcca-47a8-b973-5a46970d62c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d390f07-d4b9-4b82-94c1-67963c3370ac (dataset): DatasetConfig { id: 0d390f07-d4b9-4b82-94c1-67963c3370ac (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f18b88c-e644-4d3c-80f0-b6c1aeed737c (dataset): DatasetConfig { id: 0f18b88c-e644-4d3c-80f0-b6c1aeed737c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15406fd4-35cf-4156-8305-17195592a031 (dataset): DatasetConfig { id: 15406fd4-35cf-4156-8305-17195592a031 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16c43ac6-c959-45e4-8c39-bc99179c8bfd (dataset): DatasetConfig { id: 16c43ac6-c959-45e4-8c39-bc99179c8bfd (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16fa0fa5-e6ac-4766-80ee-2b396d936aa7 (dataset): DatasetConfig { id: 16fa0fa5-e6ac-4766-80ee-2b396d936aa7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a5db872-b159-426b-9121-e6c144e060fc (dataset): DatasetConfig { id: 1a5db872-b159-426b-9121-e6c144e060fc (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b98d5b5-fe60-4014-89de-8e3eff90256a (dataset): DatasetConfig { id: 1b98d5b5-fe60-4014-89de-8e3eff90256a (dataset), name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c2e69f9-0cff-4744-93fa-710aabdb47d1 (dataset): DatasetConfig { id: 1c2e69f9-0cff-4744-93fa-710aabdb47d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1fc2d2b6-2c29-41ea-a34d-db342a3339b5 (dataset): DatasetConfig { id: 1fc2d2b6-2c29-41ea-a34d-db342a3339b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20670492-a7a0-41e4-a432-9c5ad015a781 (dataset): DatasetConfig { id: 20670492-a7a0-41e4-a432-9c5ad015a781 (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 273b68aa-7859-42d2-8be9-390319f3dfb3 (dataset): DatasetConfig { id: 273b68aa-7859-42d2-8be9-390319f3dfb3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27850bea-f4c0-4b1c-a519-93070b1fdb35 (dataset): DatasetConfig { id: 27850bea-f4c0-4b1c-a519-93070b1fdb35 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b8fac8a-163f-4d61-baa7-627f2022707c (dataset): DatasetConfig { id: 2b8fac8a-163f-4d61-baa7-627f2022707c (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e06dbbe-8e66-4406-bf20-ae4c7606c8dc (dataset): DatasetConfig { id: 2e06dbbe-8e66-4406-bf20-ae4c7606c8dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 319f219a-cd42-41bc-a22a-22afb3a3621c (dataset): DatasetConfig { id: 319f219a-cd42-41bc-a22a-22afb3a3621c (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 324b55f6-565f-481b-815c-801dcfef084f (dataset): DatasetConfig { id: 324b55f6-565f-481b-815c-801dcfef084f (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32e18e70-1b57-4e41-a119-2bcb6cda3237 (dataset): DatasetConfig { id: 32e18e70-1b57-4e41-a119-2bcb6cda3237 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37148044-5bc1-457f-a285-3b9aa744b1cc (dataset): DatasetConfig { id: 37148044-5bc1-457f-a285-3b9aa744b1cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cb1b38b-a7e8-468d-83d2-b95ba4a9e7c8 (dataset): DatasetConfig { id: 3cb1b38b-a7e8-468d-83d2-b95ba4a9e7c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44b1ad1c-dbc1-4f9f-b645-f53b22ff623a (dataset): DatasetConfig { id: 44b1ad1c-dbc1-4f9f-b645-f53b22ff623a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4594b0e1-8d99-439e-a33f-726c7cd38d5b (dataset): DatasetConfig { id: 4594b0e1-8d99-439e-a33f-726c7cd38d5b (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d9fb840-5a54-4168-84c7-a47c9bf059c5 (dataset): DatasetConfig { id: 4d9fb840-5a54-4168-84c7-a47c9bf059c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58b2805f-cb12-46ae-bac5-b6bdbdcb1eda (dataset): DatasetConfig { id: 58b2805f-cb12-46ae-bac5-b6bdbdcb1eda (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 59c73dcf-8f67-4b13-9c83-3a2800aa000c (dataset): DatasetConfig { id: 59c73dcf-8f67-4b13-9c83-3a2800aa000c (dataset), name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6212a991-782e-40ba-adf4-c169174ee98c (dataset): DatasetConfig { id: 6212a991-782e-40ba-adf4-c169174ee98c (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69b33f33-9c6a-4644-9743-ec5ba9a5f5ea (dataset): DatasetConfig { id: 69b33f33-9c6a-4644-9743-ec5ba9a5f5ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6bbfbaa1-ea0e-420b-9ecc-30b806630998 (dataset): DatasetConfig { id: 6bbfbaa1-ea0e-420b-9ecc-30b806630998 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f5cac9a-84b0-42ff-9a15-f98cd2ceb20f (dataset): DatasetConfig { id: 6f5cac9a-84b0-42ff-9a15-f98cd2ceb20f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6f69de93-40d2-4016-97fd-fde60f5e00fe (dataset): DatasetConfig { id: 6f69de93-40d2-4016-97fd-fde60f5e00fe (dataset), name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 705ded24-2f3f-41e3-aef6-6fe377dc7356 (dataset): DatasetConfig { id: 705ded24-2f3f-41e3-aef6-6fe377dc7356 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70a50718-9b63-4827-9da5-a6e4ec75b9b1 (dataset): DatasetConfig { id: 70a50718-9b63-4827-9da5-a6e4ec75b9b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 730ca257-def9-4d2e-9b76-bf7af10d8fd1 (dataset): DatasetConfig { id: 730ca257-def9-4d2e-9b76-bf7af10d8fd1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7c2d0f95-a1bf-42fd-90b2-fd4456bd7fc6 (dataset): DatasetConfig { id: 7c2d0f95-a1bf-42fd-90b2-fd4456bd7fc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7eb2f1-5bd2-4eef-9a34-1d09d7c0c22f (dataset): DatasetConfig { id: 7f7eb2f1-5bd2-4eef-9a34-1d09d7c0c22f (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 827b92f3-0dbc-4f10-a36e-f50b97f31122 (dataset): DatasetConfig { id: 827b92f3-0dbc-4f10-a36e-f50b97f31122 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 859979f7-4742-46c6-afee-aaa8138fb126 (dataset): DatasetConfig { id: 859979f7-4742-46c6-afee-aaa8138fb126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b05a22b-9cc9-4aea-a794-77935236a280 (dataset): DatasetConfig { id: 8b05a22b-9cc9-4aea-a794-77935236a280 (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f681b07-1773-4f71-8987-adfcb0c1832c (dataset): DatasetConfig { id: 8f681b07-1773-4f71-8987-adfcb0c1832c (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94ed6fac-c121-498c-a665-717061d617ee (dataset): DatasetConfig { id: 94ed6fac-c121-498c-a665-717061d617ee (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 978c5487-0449-4aa3-adb5-53a13033a272 (dataset): DatasetConfig { id: 978c5487-0449-4aa3-adb5-53a13033a272 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d036011-6e62-450b-a15e-acba127e6c6b (dataset): DatasetConfig { id: 9d036011-6e62-450b-a15e-acba127e6c6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a11bc89d-5e37-4ba4-96e6-a799bedbb27d (dataset): DatasetConfig { id: a11bc89d-5e37-4ba4-96e6-a799bedbb27d (dataset), name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3242b27-6882-4efe-8fc9-b7f81550b292 (dataset): DatasetConfig { id: a3242b27-6882-4efe-8fc9-b7f81550b292 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5aa65ce-9471-4748-81e2-5d7f9d696440 (dataset): DatasetConfig { id: a5aa65ce-9471-4748-81e2-5d7f9d696440 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5fe1fca-7a5c-412e-b37f-44a15752ce5e (dataset): DatasetConfig { id: a5fe1fca-7a5c-412e-b37f-44a15752ce5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9ea568d-31e2-4dfc-8f49-9ea17736de46 (dataset): DatasetConfig { id: a9ea568d-31e2-4dfc-8f49-9ea17736de46 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa288249-9dcf-48e7-b40c-a4816e4ffe40 (dataset): DatasetConfig { id: aa288249-9dcf-48e7-b40c-a4816e4ffe40 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5a28152-0653-48e2-b2a7-ad0fd0249bb1 (dataset): DatasetConfig { id: b5a28152-0653-48e2-b2a7-ad0fd0249bb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c83a2d59-df2f-4e07-875a-54401066ba9f (dataset): DatasetConfig { id: c83a2d59-df2f-4e07-875a-54401066ba9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd27806f-f281-42c9-aa12-e2da68b31471 (dataset): DatasetConfig { id: cd27806f-f281-42c9-aa12-e2da68b31471 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d030d6b5-e21a-4245-8f07-3404a3ce1ed1 (dataset): DatasetConfig { id: d030d6b5-e21a-4245-8f07-3404a3ce1ed1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6d759fe-2614-403c-8001-9dbe705a1832 (dataset): DatasetConfig { id: d6d759fe-2614-403c-8001-9dbe705a1832 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8c0b3ea-2b3f-4b5c-ae85-f8fa78b73997 (dataset): DatasetConfig { id: d8c0b3ea-2b3f-4b5c-ae85-f8fa78b73997 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9d9a11c-12e2-4dc9-a65b-f46ca222f30d (dataset): DatasetConfig { id: d9d9a11c-12e2-4dc9-a65b-f46ca222f30d (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, db6a4adc-799f-4209-a027-254bbd8a7b55 (dataset): DatasetConfig { id: db6a4adc-799f-4209-a027-254bbd8a7b55 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc098f75-a420-4abc-9ffd-99d16e6aa879 (dataset): DatasetConfig { id: dc098f75-a420-4abc-9ffd-99d16e6aa879 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddbfd947-e9ee-44a1-a74c-464b73bb06bd (dataset): DatasetConfig { id: ddbfd947-e9ee-44a1-a74c-464b73bb06bd (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6b59850-f4c0-41dc-8050-3eb10eadea7a (dataset): DatasetConfig { id: e6b59850-f4c0-41dc-8050-3eb10eadea7a (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9d1dba3-90aa-448d-bbf3-8a6dc7783678 (dataset): DatasetConfig { id: e9d1dba3-90aa-448d-bbf3-8a6dc7783678 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec6b466a-540f-4767-b8ab-8b714c4831f0 (dataset): DatasetConfig { id: ec6b466a-540f-4767-b8ab-8b714c4831f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8fbe646-29bf-4176-834a-728c3c4aea25 (dataset): DatasetConfig { id: f8fbe646-29bf-4176-834a-728c3c4aea25 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f90d94d6-7de4-4929-9a74-70b1f7d3704b (dataset): DatasetConfig { id: f90d94d6-7de4-4929-9a74-70b1f7d3704b (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422025-01-28T23:04:04.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53255
4432025-01-28T23:04:04.020ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
4442025-01-28T23:04:04.020ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00a4b560-9e50-4260-b2e3-bfe52276f1e2 (dataset): DatasetConfig { id: 00a4b560-9e50-4260-b2e3-bfe52276f1e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 01e9f300-60f1-41f1-bc89-0f80c98da01c (dataset): DatasetConfig { id: 01e9f300-60f1-41f1-bc89-0f80c98da01c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0422cbf0-4e76-4d43-93b4-412fe1fa2568 (dataset): DatasetConfig { id: 0422cbf0-4e76-4d43-93b4-412fe1fa2568 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0616c314-bcca-47a8-b973-5a46970d62c8 (dataset): DatasetConfig { id: 0616c314-bcca-47a8-b973-5a46970d62c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0d390f07-d4b9-4b82-94c1-67963c3370ac (dataset): DatasetConfig { id: 0d390f07-d4b9-4b82-94c1-67963c3370ac (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f18b88c-e644-4d3c-80f0-b6c1aeed737c (dataset): DatasetConfig { id: 0f18b88c-e644-4d3c-80f0-b6c1aeed737c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 15406fd4-35cf-4156-8305-17195592a031 (dataset): DatasetConfig { id: 15406fd4-35cf-4156-8305-17195592a031 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16c43ac6-c959-45e4-8c39-bc99179c8bfd (dataset): DatasetConfig { id: 16c43ac6-c959-45e4-8c39-bc99179c8bfd (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 16fa0fa5-e6ac-4766-80ee-2b396d936aa7 (dataset): DatasetConfig { id: 16fa0fa5-e6ac-4766-80ee-2b396d936aa7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a5db872-b159-426b-9121-e6c144e060fc (dataset): DatasetConfig { id: 1a5db872-b159-426b-9121-e6c144e060fc (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1b98d5b5-fe60-4014-89de-8e3eff90256a (dataset): DatasetConfig { id: 1b98d5b5-fe60-4014-89de-8e3eff90256a (dataset), name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c2e69f9-0cff-4744-93fa-710aabdb47d1 (dataset): DatasetConfig { id: 1c2e69f9-0cff-4744-93fa-710aabdb47d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1fc2d2b6-2c29-41ea-a34d-db342a3339b5 (dataset): DatasetConfig { id: 1fc2d2b6-2c29-41ea-a34d-db342a3339b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20670492-a7a0-41e4-a432-9c5ad015a781 (dataset): DatasetConfig { id: 20670492-a7a0-41e4-a432-9c5ad015a781 (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 273b68aa-7859-42d2-8be9-390319f3dfb3 (dataset): DatasetConfig { id: 273b68aa-7859-42d2-8be9-390319f3dfb3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27850bea-f4c0-4b1c-a519-93070b1fdb35 (dataset): DatasetConfig { id: 27850bea-f4c0-4b1c-a519-93070b1fdb35 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2b8fac8a-163f-4d61-baa7-627f2022707c (dataset): DatasetConfig { id: 2b8fac8a-163f-4d61-baa7-627f2022707c (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2e06dbbe-8e66-4406-bf20-ae4c7606c8dc (dataset): DatasetConfig { id: 2e06dbbe-8e66-4406-bf20-ae4c7606c8dc (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 319f219a-cd42-41bc-a22a-22afb3a3621c (dataset): DatasetConfig { id: 319f219a-cd42-41bc-a22a-22afb3a3621c (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 324b55f6-565f-481b-815c-801dcfef084f (dataset): DatasetConfig { id: 324b55f6-565f-481b-815c-801dcfef084f (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32e18e70-1b57-4e41-a119-2bcb6cda3237 (dataset): DatasetConfig { id: 32e18e70-1b57-4e41-a119-2bcb6cda3237 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 37148044-5bc1-457f-a285-3b9aa744b1cc (dataset): DatasetConfig { id: 37148044-5bc1-457f-a285-3b9aa744b1cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3cb1b38b-a7e8-468d-83d2-b95ba4a9e7c8 (dataset): DatasetConfig { id: 3cb1b38b-a7e8-468d-83d2-b95ba4a9e7c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44b1ad1c-dbc1-4f9f-b645-f53b22ff623a (dataset): DatasetConfig { id: 44b1ad1c-dbc1-4f9f-b645-f53b22ff623a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4594b0e1-8d99-439e-a33f-726c7cd38d5b (dataset): DatasetConfig { id: 4594b0e1-8d99-439e-a33f-726c7cd38d5b (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4d9fb840-5a54-4168-84c7-a47c9bf059c5 (dataset): DatasetConfig { id: 4d9fb840-5a54-4168-84c7-a47c9bf059c5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58b2805f-cb12-46ae-bac5-b6bdbdcb1eda (dataset): DatasetConfig { id: 58b2805f-cb12-46ae-bac5-b6bdbdcb1eda (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 59c73dcf-8f67-4b13-9c83-3a2800aa000c (dataset): DatasetConfig { id: 59c73dcf-8f67-4b13-9c83-3a2800aa000c (dataset), name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6212a991-782e-40ba-adf4-c169174ee98c (dataset): DatasetConfig { id: 6212a991-782e-40ba-adf4-c169174ee98c (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 69b33f33-9c6a-4644-9743-ec5ba9a5f5ea (dataset): DatasetConfig { id: 69b33f33-9c6a-4644-9743-ec5ba9a5f5ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6bbfbaa1-ea0e-420b-9ecc-30b806630998 (dataset): DatasetConfig { id: 6bbfbaa1-ea0e-420b-9ecc-30b806630998 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f5cac9a-84b0-42ff-9a15-f98cd2ceb20f (dataset): DatasetConfig { id: 6f5cac9a-84b0-42ff-9a15-f98cd2ceb20f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6f69de93-40d2-4016-97fd-fde60f5e00fe (dataset): DatasetConfig { id: 6f69de93-40d2-4016-97fd-fde60f5e00fe (dataset), name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 705ded24-2f3f-41e3-aef6-6fe377dc7356 (dataset): DatasetConfig { id: 705ded24-2f3f-41e3-aef6-6fe377dc7356 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 70a50718-9b63-4827-9da5-a6e4ec75b9b1 (dataset): DatasetConfig { id: 70a50718-9b63-4827-9da5-a6e4ec75b9b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 730ca257-def9-4d2e-9b76-bf7af10d8fd1 (dataset): DatasetConfig { id: 730ca257-def9-4d2e-9b76-bf7af10d8fd1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7c2d0f95-a1bf-42fd-90b2-fd4456bd7fc6 (dataset): DatasetConfig { id: 7c2d0f95-a1bf-42fd-90b2-fd4456bd7fc6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7f7eb2f1-5bd2-4eef-9a34-1d09d7c0c22f (dataset): DatasetConfig { id: 7f7eb2f1-5bd2-4eef-9a34-1d09d7c0c22f (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 827b92f3-0dbc-4f10-a36e-f50b97f31122 (dataset): DatasetConfig { id: 827b92f3-0dbc-4f10-a36e-f50b97f31122 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 859979f7-4742-46c6-afee-aaa8138fb126 (dataset): DatasetConfig { id: 859979f7-4742-46c6-afee-aaa8138fb126 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8b05a22b-9cc9-4aea-a794-77935236a280 (dataset): DatasetConfig { id: 8b05a22b-9cc9-4aea-a794-77935236a280 (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f681b07-1773-4f71-8987-adfcb0c1832c (dataset): DatasetConfig { id: 8f681b07-1773-4f71-8987-adfcb0c1832c (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94ed6fac-c121-498c-a665-717061d617ee (dataset): DatasetConfig { id: 94ed6fac-c121-498c-a665-717061d617ee (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 978c5487-0449-4aa3-adb5-53a13033a272 (dataset): DatasetConfig { id: 978c5487-0449-4aa3-adb5-53a13033a272 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9d036011-6e62-450b-a15e-acba127e6c6b (dataset): DatasetConfig { id: 9d036011-6e62-450b-a15e-acba127e6c6b (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a11bc89d-5e37-4ba4-96e6-a799bedbb27d (dataset): DatasetConfig { id: a11bc89d-5e37-4ba4-96e6-a799bedbb27d (dataset), name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a3242b27-6882-4efe-8fc9-b7f81550b292 (dataset): DatasetConfig { id: a3242b27-6882-4efe-8fc9-b7f81550b292 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5aa65ce-9471-4748-81e2-5d7f9d696440 (dataset): DatasetConfig { id: a5aa65ce-9471-4748-81e2-5d7f9d696440 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a5fe1fca-7a5c-412e-b37f-44a15752ce5e (dataset): DatasetConfig { id: a5fe1fca-7a5c-412e-b37f-44a15752ce5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9ea568d-31e2-4dfc-8f49-9ea17736de46 (dataset): DatasetConfig { id: a9ea568d-31e2-4dfc-8f49-9ea17736de46 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aa288249-9dcf-48e7-b40c-a4816e4ffe40 (dataset): DatasetConfig { id: aa288249-9dcf-48e7-b40c-a4816e4ffe40 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5a28152-0653-48e2-b2a7-ad0fd0249bb1 (dataset): DatasetConfig { id: b5a28152-0653-48e2-b2a7-ad0fd0249bb1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c83a2d59-df2f-4e07-875a-54401066ba9f (dataset): DatasetConfig { id: c83a2d59-df2f-4e07-875a-54401066ba9f (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cd27806f-f281-42c9-aa12-e2da68b31471 (dataset): DatasetConfig { id: cd27806f-f281-42c9-aa12-e2da68b31471 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d030d6b5-e21a-4245-8f07-3404a3ce1ed1 (dataset): DatasetConfig { id: d030d6b5-e21a-4245-8f07-3404a3ce1ed1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6d759fe-2614-403c-8001-9dbe705a1832 (dataset): DatasetConfig { id: d6d759fe-2614-403c-8001-9dbe705a1832 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d8c0b3ea-2b3f-4b5c-ae85-f8fa78b73997 (dataset): DatasetConfig { id: d8c0b3ea-2b3f-4b5c-ae85-f8fa78b73997 (dataset), name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d9d9a11c-12e2-4dc9-a65b-f46ca222f30d (dataset): DatasetConfig { id: d9d9a11c-12e2-4dc9-a65b-f46ca222f30d (dataset), name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, db6a4adc-799f-4209-a027-254bbd8a7b55 (dataset): DatasetConfig { id: db6a4adc-799f-4209-a027-254bbd8a7b55 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dc098f75-a420-4abc-9ffd-99d16e6aa879 (dataset): DatasetConfig { id: dc098f75-a420-4abc-9ffd-99d16e6aa879 (dataset), name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ddbfd947-e9ee-44a1-a74c-464b73bb06bd (dataset): DatasetConfig { id: ddbfd947-e9ee-44a1-a74c-464b73bb06bd (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6b59850-f4c0-41dc-8050-3eb10eadea7a (dataset): DatasetConfig { id: e6b59850-f4c0-41dc-8050-3eb10eadea7a (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e9d1dba3-90aa-448d-bbf3-8a6dc7783678 (dataset): DatasetConfig { id: e9d1dba3-90aa-448d-bbf3-8a6dc7783678 (dataset), name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec6b466a-540f-4767-b8ab-8b714c4831f0 (dataset): DatasetConfig { id: ec6b466a-540f-4767-b8ab-8b714c4831f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f8fbe646-29bf-4176-834a-728c3c4aea25 (dataset): DatasetConfig { id: f8fbe646-29bf-4176-834a-728c3c4aea25 (dataset), name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f90d94d6-7de4-4929-9a74-70b1f7d3704b (dataset): DatasetConfig { id: f90d94d6-7de4-4929-9a74-70b1f7d3704b (dataset), name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4452025-01-28T23:04:04.020ZINFOSledAgent (StorageManager): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462025-01-28T23:04:04.020ZINFOSledAgent (StorageManager): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-01-28T23:04:04.020ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4482025-01-28T23:04:04.035ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4492025-01-28T23:04:04.035ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4502025-01-28T23:04:04.035ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/zone/oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600"), full_name: "oxp_68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/zone/oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600" } file = sled-storage/src/manager.rs:1431
4512025-01-28T23:04:04.095ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522025-01-28T23:04:04.095ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532025-01-28T23:04:04.095ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/zone/oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c"), full_name: "oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/zone/oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c" } file = sled-storage/src/manager.rs:1431
4542025-01-28T23:04:04.156ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-01-28T23:04:04.156ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4562025-01-28T23:04:04.156ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/zone/oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9"), full_name: "oxp_79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/zone/oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9" } file = sled-storage/src/manager.rs:1431
4572025-01-28T23:04:04.182ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/333ba0f0-e056-439e-a4d5-a88dac7ac1cc) file = sled-agent/src/probe_manager.rs:231 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
4582025-01-28T23:04:04.214ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-01-28T23:04:04.214ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602025-01-28T23:04:04.214ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/zone/oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b"), full_name: "oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/zone/oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b" } file = sled-storage/src/manager.rs:1431
4612025-01-28T23:04:04.274ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-28T23:04:04.274ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-01-28T23:04:04.274ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/zone/oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7"), full_name: "oxp_ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/zone/oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7" } file = sled-storage/src/manager.rs:1431
4642025-01-28T23:04:04.335ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-01-28T23:04:04.335ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4662025-01-28T23:04:04.335ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/zone"), full_name: "oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/zone" } file = sled-storage/src/manager.rs:1431
4672025-01-28T23:04:04.365ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-28T23:04:04.365ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-01-28T23:04:04.365ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b" } file = sled-storage/src/manager.rs:1431
4702025-01-28T23:04:04.425ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-28T23:04:04.425ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722025-01-28T23:04:04.425ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4732025-01-28T23:04:04.474ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-28T23:04:04.474ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4752025-01-28T23:04:04.474ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crucible" } file = sled-storage/src/manager.rs:1431
4762025-01-28T23:04:04.521ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4772025-01-28T23:04:04.521ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4782025-01-28T23:04:04.521ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4792025-01-28T23:04:04.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4802025-01-28T23:04:04.569ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4812025-01-28T23:04:04.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b6f4a7de-ae5d-4497-bee3-21826d504667/crucible" } file = sled-storage/src/manager.rs:1431
4822025-01-28T23:04:04.617ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4832025-01-28T23:04:04.617ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4842025-01-28T23:04:04.617ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/debug"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/debug" } file = sled-storage/src/manager.rs:1431
4852025-01-28T23:04:04.647ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4862025-01-28T23:04:04.647ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4872025-01-28T23:04:04.647ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/099773d5-5f69-4f65-8f86-75c48d557e90/crypt/zone/oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285"), full_name: "oxp_099773d5-5f69-4f65-8f86-75c48d557e90/crypt/zone/oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285" } file = sled-storage/src/manager.rs:1431
4882025-01-28T23:04:04.707ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4892025-01-28T23:04:04.707ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4902025-01-28T23:04:04.707ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_099773d5-5f69-4f65-8f86-75c48d557e90/crucible" } file = sled-storage/src/manager.rs:1431
4912025-01-28T23:04:04.756ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4922025-01-28T23:04:04.756ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4932025-01-28T23:04:04.756ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c" } file = sled-storage/src/manager.rs:1431
4942025-01-28T23:04:04.817ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4952025-01-28T23:04:04.817ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4962025-01-28T23:04:04.817ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4972025-01-28T23:04:04.866ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4982025-01-28T23:04:04.866ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4992025-01-28T23:04:04.866ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone" } file = sled-storage/src/manager.rs:1431
5002025-01-28T23:04:04.894ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-01-28T23:04:04.894ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5022025-01-28T23:04:04.894ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/debug"), full_name: "oxp_79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/debug" } file = sled-storage/src/manager.rs:1431
5032025-01-28T23:04:04.923ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-01-28T23:04:04.923ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052025-01-28T23:04:04.923ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/zone/oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156"), full_name: "oxp_68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/zone/oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156" } file = sled-storage/src/manager.rs:1431
5062025-01-28T23:04:04.983ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-01-28T23:04:04.983ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-01-28T23:04:04.983ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/099773d5-5f69-4f65-8f86-75c48d557e90/crypt/zone/oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c"), full_name: "oxp_099773d5-5f69-4f65-8f86-75c48d557e90/crypt/zone/oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c" } file = sled-storage/src/manager.rs:1431
5092025-01-28T23:04:05.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-01-28T23:04:05.046ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-01-28T23:04:05.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_68044c5c-97c7-414c-b44a-b8251f523a8f/crucible" } file = sled-storage/src/manager.rs:1431
5122025-01-28T23:04:05.094ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-01-28T23:04:05.094ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5142025-01-28T23:04:05.094ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/zone/oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654"), full_name: "oxp_68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/zone/oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654" } file = sled-storage/src/manager.rs:1431
5152025-01-28T23:04:05.154ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-01-28T23:04:05.154ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5172025-01-28T23:04:05.154ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/zone"), full_name: "oxp_68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/zone" } file = sled-storage/src/manager.rs:1431
5182025-01-28T23:04:05.182ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-01-28T23:04:05.182ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-01-28T23:04:05.182ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/zone/oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b"), full_name: "oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/zone/oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b" } file = sled-storage/src/manager.rs:1431
5212025-01-28T23:04:05.186ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/333ba0f0-e056-439e-a4d5-a88dac7ac1cc) file = sled-agent/src/probe_manager.rs:231 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
5222025-01-28T23:04:05.242ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-28T23:04:05.242ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-01-28T23:04:05.242ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee" } file = sled-storage/src/manager.rs:1431
5252025-01-28T23:04:05.302ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5262025-01-28T23:04:05.302ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5272025-01-28T23:04:05.302ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crucible" } file = sled-storage/src/manager.rs:1431
5282025-01-28T23:04:05.349ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5292025-01-28T23:04:05.349ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5302025-01-28T23:04:05.349ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/debug"), full_name: "oxp_ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/debug" } file = sled-storage/src/manager.rs:1431
5312025-01-28T23:04:05.378ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5322025-01-28T23:04:05.378ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5332025-01-28T23:04:05.378ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b6f4a7de-ae5d-4497-bee3-21826d504667/crypt/zone/oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38"), full_name: "oxp_b6f4a7de-ae5d-4497-bee3-21826d504667/crypt/zone/oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38" } file = sled-storage/src/manager.rs:1431
5342025-01-28T23:04:05.436ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5352025-01-28T23:04:05.436ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5362025-01-28T23:04:05.436ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone/oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone/oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9" } file = sled-storage/src/manager.rs:1431
5372025-01-28T23:04:05.494ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5382025-01-28T23:04:05.494ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5392025-01-28T23:04:05.494ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/zone"), full_name: "oxp_79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/zone" } file = sled-storage/src/manager.rs:1431
5402025-01-28T23:04:05.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5412025-01-28T23:04:05.524ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5422025-01-28T23:04:05.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
5432025-01-28T23:04:05.573ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5442025-01-28T23:04:05.573ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5452025-01-28T23:04:05.573ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/debug"), full_name: "oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/debug" } file = sled-storage/src/manager.rs:1431
5462025-01-28T23:04:05.602ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5472025-01-28T23:04:05.602ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5482025-01-28T23:04:05.602ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b6f4a7de-ae5d-4497-bee3-21826d504667/crypt/debug"), full_name: "oxp_b6f4a7de-ae5d-4497-bee3-21826d504667/crypt/debug" } file = sled-storage/src/manager.rs:1431
5492025-01-28T23:04:05.630ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5502025-01-28T23:04:05.630ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5512025-01-28T23:04:05.630ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/zone/oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306"), full_name: "oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/zone/oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306" } file = sled-storage/src/manager.rs:1431
5522025-01-28T23:04:05.689ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5532025-01-28T23:04:05.689ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5542025-01-28T23:04:05.689ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone/oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone/oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563" } file = sled-storage/src/manager.rs:1431
5552025-01-28T23:04:05.748ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5562025-01-28T23:04:05.748ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5572025-01-28T23:04:05.748ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/debug"), full_name: "oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/debug" } file = sled-storage/src/manager.rs:1431
5582025-01-28T23:04:05.778ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5592025-01-28T23:04:05.779ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5602025-01-28T23:04:05.779ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/zone/oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2"), full_name: "oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/zone/oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2" } file = sled-storage/src/manager.rs:1431
5612025-01-28T23:04:05.838ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5622025-01-28T23:04:05.839ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5632025-01-28T23:04:05.839ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/099773d5-5f69-4f65-8f86-75c48d557e90/crypt/zone/oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693"), full_name: "oxp_099773d5-5f69-4f65-8f86-75c48d557e90/crypt/zone/oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693" } file = sled-storage/src/manager.rs:1431
5642025-01-28T23:04:05.895ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-01-28T23:04:05.895ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5662025-01-28T23:04:05.895ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501" } file = sled-storage/src/manager.rs:1431
5672025-01-28T23:04:05.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-01-28T23:04:05.955ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692025-01-28T23:04:05.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5702025-01-28T23:04:06.006ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-01-28T23:04:06.006ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5722025-01-28T23:04:06.006ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/099773d5-5f69-4f65-8f86-75c48d557e90/crypt/zone"), full_name: "oxp_099773d5-5f69-4f65-8f86-75c48d557e90/crypt/zone" } file = sled-storage/src/manager.rs:1431
5732025-01-28T23:04:06.035ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-01-28T23:04:06.035ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752025-01-28T23:04:06.035ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095" } file = sled-storage/src/manager.rs:1431
5762025-01-28T23:04:06.096ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-01-28T23:04:06.096ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782025-01-28T23:04:06.096ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_79dc877f-201a-4a6a-a185-dc64a57ed603/crucible" } file = sled-storage/src/manager.rs:1431
5792025-01-28T23:04:06.143ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-01-28T23:04:06.143ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812025-01-28T23:04:06.143ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/zone/oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4"), full_name: "oxp_ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/zone/oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4" } file = sled-storage/src/manager.rs:1431
5822025-01-28T23:04:06.187ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/333ba0f0-e056-439e-a4d5-a88dac7ac1cc) file = sled-agent/src/probe_manager.rs:231 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
5832025-01-28T23:04:06.202ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5842025-01-28T23:04:06.202ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5852025-01-28T23:04:06.202ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5862025-01-28T23:04:06.252ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5872025-01-28T23:04:06.252ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5882025-01-28T23:04:06.252ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b6f4a7de-ae5d-4497-bee3-21826d504667/crypt/zone"), full_name: "oxp_b6f4a7de-ae5d-4497-bee3-21826d504667/crypt/zone" } file = sled-storage/src/manager.rs:1431
5892025-01-28T23:04:06.280ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5902025-01-28T23:04:06.280ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5912025-01-28T23:04:06.280ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone" } file = sled-storage/src/manager.rs:1431
5922025-01-28T23:04:06.308ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5932025-01-28T23:04:06.308ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5942025-01-28T23:04:06.308ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ff6949fe-2851-437a-b6e9-cb91f2325920/crucible" } file = sled-storage/src/manager.rs:1431
5952025-01-28T23:04:06.355ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5962025-01-28T23:04:06.355ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5972025-01-28T23:04:06.355ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5982025-01-28T23:04:06.403ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5992025-01-28T23:04:06.403ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6002025-01-28T23:04:06.403ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crucible" } file = sled-storage/src/manager.rs:1431
6012025-01-28T23:04:06.451ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6022025-01-28T23:04:06.451ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6032025-01-28T23:04:06.451ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/zone"), full_name: "oxp_ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/zone" } file = sled-storage/src/manager.rs:1431
6042025-01-28T23:04:06.479ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6052025-01-28T23:04:06.479ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6062025-01-28T23:04:06.479ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/debug"), full_name: "oxp_68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/debug" } file = sled-storage/src/manager.rs:1431
6072025-01-28T23:04:06.507ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6082025-01-28T23:04:06.507ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6092025-01-28T23:04:06.507ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/zone/oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b"), full_name: "oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/zone/oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b" } file = sled-storage/src/manager.rs:1431
6102025-01-28T23:04:06.567ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6112025-01-28T23:04:06.567ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6122025-01-28T23:04:06.567ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6132025-01-28T23:04:06.616ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6142025-01-28T23:04:06.616ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6152025-01-28T23:04:06.616ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/zone/oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732" } file = sled-storage/src/manager.rs:1431
6162025-01-28T23:04:06.677ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6172025-01-28T23:04:06.677ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6182025-01-28T23:04:06.677ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6192025-01-28T23:04:06.726ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6202025-01-28T23:04:06.726ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6212025-01-28T23:04:06.726ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/zone"), full_name: "oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/zone" } file = sled-storage/src/manager.rs:1431
6222025-01-28T23:04:06.756ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6232025-01-28T23:04:06.756ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6242025-01-28T23:04:06.756ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/099773d5-5f69-4f65-8f86-75c48d557e90/crypt/debug"), full_name: "oxp_099773d5-5f69-4f65-8f86-75c48d557e90/crypt/debug" } file = sled-storage/src/manager.rs:1431
6252025-01-28T23:04:06.785ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6262025-01-28T23:04:06.785ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6272025-01-28T23:04:06.785ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone/oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone/oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d" } file = sled-storage/src/manager.rs:1431
6282025-01-28T23:04:06.843ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-01-28T23:04:06.843ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6302025-01-28T23:04:06.843ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/46e85043-614f-4a55-8660-1ccd892d22b2/crypt/debug"), full_name: "oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crypt/debug" } file = sled-storage/src/manager.rs:1431
6312025-01-28T23:04:06.872ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-01-28T23:04:06.872ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332025-01-28T23:04:06.872ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone/oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/zone/oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490" } file = sled-storage/src/manager.rs:1431
6342025-01-28T23:04:06.932ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-01-28T23:04:06.932ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362025-01-28T23:04:06.932ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible" } file = sled-storage/src/manager.rs:1431
6372025-01-28T23:04:06.981ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-01-28T23:04:06.981ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-01-28T23:04:06.981ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6402025-01-28T23:04:07.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-01-28T23:04:07.031ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-01-28T23:04:07.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/zone/oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88"), full_name: "oxp_ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/zone/oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88" } file = sled-storage/src/manager.rs:1431
6432025-01-28T23:04:07.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-01-28T23:04:07.090ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452025-01-28T23:04:07.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6462025-01-28T23:04:07.141ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-01-28T23:04:07.141ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482025-01-28T23:04:07.141ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/zone/oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e"), full_name: "oxp_79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/zone/oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e" } file = sled-storage/src/manager.rs:1431
6492025-01-28T23:04:07.189ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/333ba0f0-e056-439e-a4d5-a88dac7ac1cc) file = sled-agent/src/probe_manager.rs:231 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
6502025-01-28T23:04:07.205ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-01-28T23:04:07.206ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6522025-01-28T23:04:07.206ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
6532025-01-28T23:04:07.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3186575 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53255 req_id = a78e48d1-19d0-4970-8e90-fc6d3c76c41f response_code = 200 uri = /datasets
6542025-01-28T23:04:07.238ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: dae4f93f-35ac-4030-9420-e14e5ea8d9ee (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b7d629c3-43a9-4371-ba4a-bc36f41a62f9 (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 70effdad-f00a-4794-9092-69663f1aeca2 (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6552025-01-28T23:04:07.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50064
6562025-01-28T23:04:07.238ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572025-01-28T23:04:07.238ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582025-01-28T23:04:07.248ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-01-28T23:04:07.248ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-01-28T23:04:07.257ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6612025-01-28T23:04:07.257ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6622025-01-28T23:04:07.265ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6632025-01-28T23:04:07.266ZINFOSledAgent (ServiceManager): No ledger in /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-01-28T23:04:07.266ZINFOSledAgent (ServiceManager): No ledger in /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:188
6652025-01-28T23:04:07.266ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-28T23:04:07.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-28T23:04:07.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-28T23:04:07.308ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6692025-01-28T23:04:07.360ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9 file = illumos-utils/src/zone.rs:325
6702025-01-28T23:04:07.364ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2 file = illumos-utils/src/zone.rs:325
6712025-01-28T23:04:07.368ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee file = illumos-utils/src/zone.rs:325
6722025-01-28T23:04:07.380ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9 file = illumos-utils/src/zone.rs:363
6732025-01-28T23:04:07.385ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2 file = illumos-utils/src/zone.rs:363
6742025-01-28T23:04:07.389ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee file = illumos-utils/src/zone.rs:363
6752025-01-28T23:04:08.191ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/333ba0f0-e056-439e-a4d5-a88dac7ac1cc) file = sled-agent/src/probe_manager.rs:231 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
6762025-01-28T23:04:08.937ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6772025-01-28T23:04:08.937ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6782025-01-28T23:04:08.938ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
6792025-01-28T23:04:09.425ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6802025-01-28T23:04:09.657ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6812025-01-28T23:04:09.657ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6822025-01-28T23:04:09.663ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6832025-01-28T23:04:09.663ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6842025-01-28T23:04:09.811ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
6852025-01-28T23:04:09.811ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
6862025-01-28T23:04:09.853ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
6872025-01-28T23:04:09.853ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
6882025-01-28T23:04:09.878ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10650201298205028199 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
6892025-01-28T23:04:09.878ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9418016199096256881 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
6902025-01-28T23:04:09.905ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
6912025-01-28T23:04:09.905ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
6922025-01-28T23:04:09.908ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6932025-01-28T23:04:09.908ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6942025-01-28T23:04:09.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2") failed: Property not found. retry in 62.916168ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
6952025-01-28T23:04:09.916ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6962025-01-28T23:04:09.917ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
6972025-01-28T23:04:09.923ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
6982025-01-28T23:04:09.931ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
6992025-01-28T23:04:09.931ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
7002025-01-28T23:04:09.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2") failed: Property not found. retry in 142.498666ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
7012025-01-28T23:04:10.009ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
7022025-01-28T23:04:10.010ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
7032025-01-28T23:04:10.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee") failed: Property not found. retry in 65.664042ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7042025-01-28T23:04:10.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9") failed: Property not found. retry in 34.238864ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7052025-01-28T23:04:10.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9") failed: Property not found. retry in 53.687275ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7062025-01-28T23:04:10.108ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7072025-01-28T23:04:10.108ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7082025-01-28T23:04:10.223ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee") failed: Property not found. retry in 148.510997ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7092025-01-28T23:04:10.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9") failed: Property not found. retry in 155.797458ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7102025-01-28T23:04:10.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2") failed: Property not found. retry in 193.578718ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
7112025-01-28T23:04:10.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee") failed: Property not found. retry in 106.44482ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7122025-01-28T23:04:10.463ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7132025-01-28T23:04:10.571ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7142025-01-28T23:04:10.571ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7152025-01-28T23:04:10.572ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7162025-01-28T23:04:10.572ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7172025-01-28T23:04:10.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee") failed: Property not found. retry in 372.894698ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7182025-01-28T23:04:10.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9") failed: Property not found. retry in 446.817507ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7192025-01-28T23:04:10.630ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7202025-01-28T23:04:10.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2") failed: Property not found. retry in 524.627422ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
7212025-01-28T23:04:10.708ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7222025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7232025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7242025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7252025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7262025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7272025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7282025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7292025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7302025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7312025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7322025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7332025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7342025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7352025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7362025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7372025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7382025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7392025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7402025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7412025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7422025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7432025-01-28T23:04:10.708ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7442025-01-28T23:04:10.860ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 251898852608411906 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
7452025-01-28T23:04:10.860ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10512205622993224981 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
7462025-01-28T23:04:10.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee") failed: Property not found. retry in 784.411053ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7472025-01-28T23:04:11.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9") failed: Property not found. retry in 619.14487ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7482025-01-28T23:04:11.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2") failed: Property not found. retry in 571.174796ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
7492025-01-28T23:04:11.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9") failed: Property not found. retry in 782.5214ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7502025-01-28T23:04:11.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee") failed: Property not found. retry in 1.357676345s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7512025-01-28T23:04:11.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2") failed: Property not found. retry in 1.09972256s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
7522025-01-28T23:04:12.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9") failed: Property not found. retry in 596.903574ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7532025-01-28T23:04:12.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2") failed: Property not found. retry in 750.146017ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
7542025-01-28T23:04:13.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9") failed: Property not found. retry in 1.075628919s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7552025-01-28T23:04:13.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee") failed: Property not found. retry in 861.770931ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7562025-01-28T23:04:13.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2") failed: Property not found. retry in 1.124280119s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
7572025-01-28T23:04:13.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee") failed: Property not found. retry in 615.042472ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7582025-01-28T23:04:14.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9") failed: Property not found. retry in 1.151113643s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7592025-01-28T23:04:14.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee") failed: Property not found. retry in 1.271467548s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7602025-01-28T23:04:15.903ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_dae4f93f-35ac-4030-9420-e14e5ea8d9ee
7612025-01-28T23:04:15.903ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_b7d629c3-43a9-4371-ba4a-bc36f41a62f9
7622025-01-28T23:04:15.903ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_70effdad-f00a-4794-9092-69663f1aeca2
7632025-01-28T23:04:15.903ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642025-01-28T23:04:15.904ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7652025-01-28T23:04:15.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8666037 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50064 req_id = 167b0661-86c9-435e-a532-4e394ace6162 response_code = 204 uri = /omicron-zones
7662025-01-28T23:04:15.907ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7672025-01-28T23:04:16.036ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 148.407951ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7682025-01-28T23:04:16.202ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7692025-01-28T23:04:16.249ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7702025-01-28T23:04:16.303ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7712025-01-28T23:04:16.303ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7722025-01-28T23:04:16.335ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7732025-01-28T23:04:16.335ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7742025-01-28T23:04:16.335ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7752025-01-28T23:04:16.364ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: dae4f93f-35ac-4030-9420-e14e5ea8d9ee (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b7d629c3-43a9-4371-ba4a-bc36f41a62f9 (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 70effdad-f00a-4794-9092-69663f1aeca2 (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: de55335f-5cf0-42da-a609-77d7ebc1083e (service), filesystem_pool: Some(ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4b02f0f0-df74-4f61-b20c-210e6f4218f7, kind: Service { id: de55335f-5cf0-42da-a609-77d7ebc1083e }, name: Name("ntp-de55335f-5cf0-42da-a609-77d7ebc1083e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 131])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7762025-01-28T23:04:16.365ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62248
7772025-01-28T23:04:16.365ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7782025-01-28T23:04:16.365ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7792025-01-28T23:04:16.377ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802025-01-28T23:04:16.377ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812025-01-28T23:04:16.387ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7822025-01-28T23:04:16.388ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7832025-01-28T23:04:16.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7842025-01-28T23:04:16.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
7852025-01-28T23:04:16.397ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
7862025-01-28T23:04:16.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7872025-01-28T23:04:16.409ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7882025-01-28T23:04:16.441ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7892025-01-28T23:04:16.441ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7902025-01-28T23:04:16.441ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7912025-01-28T23:04:16.471ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 140, 131]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7922025-01-28T23:04:16.471ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7932025-01-28T23:04:16.471ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7942025-01-28T23:04:16.471ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7952025-01-28T23:04:16.472ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7962025-01-28T23:04:16.472ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7972025-01-28T23:04:16.497ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e file = illumos-utils/src/zone.rs:325
7982025-01-28T23:04:16.515ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e file = illumos-utils/src/zone.rs:363
7992025-01-28T23:04:17.131ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8002025-01-28T23:04:17.131ZINFOSledAgent (ServiceManager): Booting oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8012025-01-28T23:04:17.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e") failed: Property not found. retry in 69.039385ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8022025-01-28T23:04:17.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e") failed: Property not found. retry in 92.717741ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8032025-01-28T23:04:17.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e") failed: Property not found. retry in 280.587921ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8042025-01-28T23:04:17.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e") failed: Property not found. retry in 317.538422ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8052025-01-28T23:04:18.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e") failed: Property not found. retry in 500.24948ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8062025-01-28T23:04:18.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e") failed: Property not found. retry in 1.475035541s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8072025-01-28T23:04:19.880ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10650201298205028199 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8082025-01-28T23:04:19.880ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9418016199096256881 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8092025-01-28T23:04:20.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e") failed: Property not found. retry in 610.797646ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8102025-01-28T23:04:20.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e") failed: Property not found. retry in 996.932101ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8112025-01-28T23:04:20.817ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 12.448147623s error = "no record found for Query { name: Name(\\"_nexus._tcp.control-plane.oxide.internal.\\"), query_type: SRV, query_class: IN }" file = oximeter/producer/src/lib.rs:387 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8122025-01-28T23:04:20.862ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 251898852608411906 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8132025-01-28T23:04:20.862ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10512205622993224981 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8142025-01-28T23:04:21.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e") failed: Property not found. retry in 853.604349ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8152025-01-28T23:04:22.591ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e
8162025-01-28T23:04:22.591ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8172025-01-28T23:04:22.592ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8182025-01-28T23:04:22.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6227304 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62248 req_id = 80bfcdc9-abde-4def-ba08-54e068e7ba70 response_code = 204 uri = /omicron-zones
8192025-01-28T23:04:22.594ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8202025-01-28T23:04:22.624ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8212025-01-28T23:04:22.624ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57250
8222025-01-28T23:04:22.633ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8232025-01-28T23:04:22.633ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9088 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57250 req_id = cd44f2fb-5625-4b60-b1a2-1cc343159409 response_code = 500 uri = /timesync
8242025-01-28T23:04:22.636ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8252025-01-28T23:04:22.749ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8262025-01-28T23:04:22.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39977
8272025-01-28T23:04:24.779ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7618931781178630758 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8282025-01-28T23:04:25.332ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13936210959078494306 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8292025-01-28T23:04:25.907ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11059666121201518312 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8302025-01-28T23:04:26.759ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8312025-01-28T23:04:26.759ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39977 req_id = bac92dee-1c4d-4c50-8f77-d613308696e4 response_code = 500 uri = /timesync
8322025-01-28T23:04:26.761ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8332025-01-28T23:04:26.871ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8342025-01-28T23:04:26.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43731
8352025-01-28T23:04:26.880ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8362025-01-28T23:04:26.880ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8798 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43731 req_id = f0d774f4-f7c6-4b87-a904-daf3f0dd05c1 response_code = 500 uri = /timesync
8372025-01-28T23:04:26.883ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8382025-01-28T23:04:27.054ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8392025-01-28T23:04:27.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61860
8402025-01-28T23:04:29.881ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10650201298205028199 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8412025-01-28T23:04:29.882ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9418016199096256881 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8422025-01-28T23:04:30.866ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 251898852608411906 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8432025-01-28T23:04:30.866ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10512205622993224981 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
8442025-01-28T23:04:31.066ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_de55335f-5cf0-42da-a609-77d7ebc1083e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8452025-01-28T23:04:31.066ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61860 req_id = 6d8337ca-c082-461b-ac49-41ceccfb75f7 response_code = 500 uri = /timesync
8462025-01-28T23:04:31.069ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8472025-01-28T23:04:31.230ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8482025-01-28T23:04:31.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41929
8492025-01-28T23:04:31.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 22279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41929 req_id = 38653153-d82f-4f17-8ec2-2266970c4a81 response_code = 200 uri = /timesync
8502025-01-28T23:04:31.255ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1255149205, ip_addr: 74.208.14.149, stratum: 5, ref_time: 1738105470.9538538, correction: 0.026196688 } file = sled-agent/src/rack_setup/service.rs:743
8512025-01-28T23:04:31.255ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1383
8522025-01-28T23:04:31.285ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: dae4f93f-35ac-4030-9420-e14e5ea8d9ee (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b7d629c3-43a9-4371-ba4a-bc36f41a62f9 (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 70effdad-f00a-4794-9092-69663f1aeca2 (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: de55335f-5cf0-42da-a609-77d7ebc1083e (service), filesystem_pool: Some(ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4b02f0f0-df74-4f61-b20c-210e6f4218f7, kind: Service { id: de55335f-5cf0-42da-a609-77d7ebc1083e }, name: Name("ntp-de55335f-5cf0-42da-a609-77d7ebc1083e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 131])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 6b033680-49cf-4495-a0e0-056bbe4ab095 (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: d0d250fe-36e3-4ca5-bd85-9b908c11378d (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } } } }, OmicronZoneConfig { id: 17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53b89418-4718-43ca-90c2-94f5822e6fc7 (service), filesystem_pool: Some(ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External } } } }, OmicronZoneConfig { id: c08aa32b-a2d1-49e8-bcd1-2e087a63170b (service), filesystem_pool: Some(ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8532025-01-28T23:04:31.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59542
8542025-01-28T23:04:31.285ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8552025-01-28T23:04:31.285ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8562025-01-28T23:04:31.296ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8572025-01-28T23:04:31.296ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8582025-01-28T23:04:31.306ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8592025-01-28T23:04:31.306ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8602025-01-28T23:04:31.313ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8612025-01-28T23:04:31.313ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8622025-01-28T23:04:31.322ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8632025-01-28T23:04:31.322ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8642025-01-28T23:04:31.330ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8652025-01-28T23:04:31.330ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8662025-01-28T23:04:31.338ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8672025-01-28T23:04:31.338ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8682025-01-28T23:04:31.347ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8692025-01-28T23:04:31.347ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8702025-01-28T23:04:31.356ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8712025-01-28T23:04:31.356ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
8722025-01-28T23:04:31.357ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
8732025-01-28T23:04:31.357ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8742025-01-28T23:04:31.390ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
8752025-01-28T23:04:31.390ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
8762025-01-28T23:04:31.390ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
8772025-01-28T23:04:31.390ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
8782025-01-28T23:04:31.390ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
8792025-01-28T23:04:31.390ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7", TimeNotSynchronized), ("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b", TimeNotSynchronized), ("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d", TimeNotSynchronized), ("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095", TimeNotSynchronized), ("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 105055 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59542 req_id = 4f268ab9-4211-4795-9f02-851d66ff185d response_code = 500 uri = /omicron-zones
8802025-01-28T23:04:31.390ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4f268ab9-4211-4795-9f02-851d66ff185d", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4f268ab9-4211-4795-9f02-851d66ff185d" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 122.188281ms sled_address = [fd00:1122:3344:101::1]:12345
8812025-01-28T23:04:31.514ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: dae4f93f-35ac-4030-9420-e14e5ea8d9ee (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b7d629c3-43a9-4371-ba4a-bc36f41a62f9 (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 70effdad-f00a-4794-9092-69663f1aeca2 (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: de55335f-5cf0-42da-a609-77d7ebc1083e (service), filesystem_pool: Some(ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4b02f0f0-df74-4f61-b20c-210e6f4218f7, kind: Service { id: de55335f-5cf0-42da-a609-77d7ebc1083e }, name: Name("ntp-de55335f-5cf0-42da-a609-77d7ebc1083e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 131])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 6b033680-49cf-4495-a0e0-056bbe4ab095 (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: d0d250fe-36e3-4ca5-bd85-9b908c11378d (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } } } }, OmicronZoneConfig { id: 17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53b89418-4718-43ca-90c2-94f5822e6fc7 (service), filesystem_pool: Some(ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External } } } }, OmicronZoneConfig { id: c08aa32b-a2d1-49e8-bcd1-2e087a63170b (service), filesystem_pool: Some(ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8822025-01-28T23:04:31.514ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8832025-01-28T23:04:31.514ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8842025-01-28T23:04:31.523ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8852025-01-28T23:04:31.523ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8862025-01-28T23:04:31.532ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8872025-01-28T23:04:31.532ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8882025-01-28T23:04:31.540ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8892025-01-28T23:04:31.540ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8902025-01-28T23:04:31.550ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8912025-01-28T23:04:31.550ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8922025-01-28T23:04:31.559ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8932025-01-28T23:04:31.559ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8942025-01-28T23:04:31.569ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8952025-01-28T23:04:31.569ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8962025-01-28T23:04:31.577ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8972025-01-28T23:04:31.577ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8982025-01-28T23:04:31.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8992025-01-28T23:04:31.586ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
9002025-01-28T23:04:31.586ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
9012025-01-28T23:04:31.586ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9022025-01-28T23:04:31.617ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
9032025-01-28T23:04:31.617ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
9042025-01-28T23:04:31.617ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
9052025-01-28T23:04:31.617ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
9062025-01-28T23:04:31.617ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
9072025-01-28T23:04:31.617ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b", TimeNotSynchronized), ("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095", TimeNotSynchronized), ("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d", TimeNotSynchronized), ("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7", TimeNotSynchronized), ("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 102880 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59542 req_id = 2f8d1bbb-03b3-42f4-8174-dede858e6530 response_code = 500 uri = /omicron-zones
9082025-01-28T23:04:31.617ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2f8d1bbb-03b3-42f4-8174-dede858e6530", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2f8d1bbb-03b3-42f4-8174-dede858e6530" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 114.390304ms sled_address = [fd00:1122:3344:101::1]:12345
9092025-01-28T23:04:31.733ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: dae4f93f-35ac-4030-9420-e14e5ea8d9ee (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b7d629c3-43a9-4371-ba4a-bc36f41a62f9 (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 70effdad-f00a-4794-9092-69663f1aeca2 (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: de55335f-5cf0-42da-a609-77d7ebc1083e (service), filesystem_pool: Some(ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4b02f0f0-df74-4f61-b20c-210e6f4218f7, kind: Service { id: de55335f-5cf0-42da-a609-77d7ebc1083e }, name: Name("ntp-de55335f-5cf0-42da-a609-77d7ebc1083e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 131])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 6b033680-49cf-4495-a0e0-056bbe4ab095 (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: d0d250fe-36e3-4ca5-bd85-9b908c11378d (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } } } }, OmicronZoneConfig { id: 17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53b89418-4718-43ca-90c2-94f5822e6fc7 (service), filesystem_pool: Some(ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External } } } }, OmicronZoneConfig { id: c08aa32b-a2d1-49e8-bcd1-2e087a63170b (service), filesystem_pool: Some(ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9102025-01-28T23:04:31.733ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9112025-01-28T23:04:31.733ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9122025-01-28T23:04:31.744ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9132025-01-28T23:04:31.744ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9142025-01-28T23:04:31.754ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9152025-01-28T23:04:31.754ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9162025-01-28T23:04:31.763ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9172025-01-28T23:04:31.763ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9182025-01-28T23:04:31.773ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9192025-01-28T23:04:31.773ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9202025-01-28T23:04:31.782ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9212025-01-28T23:04:31.782ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9222025-01-28T23:04:31.791ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9232025-01-28T23:04:31.791ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9242025-01-28T23:04:31.800ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9252025-01-28T23:04:31.800ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9262025-01-28T23:04:31.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9272025-01-28T23:04:31.810ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
9282025-01-28T23:04:31.810ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
9292025-01-28T23:04:31.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9302025-01-28T23:04:31.843ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
9312025-01-28T23:04:31.843ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
9322025-01-28T23:04:31.843ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
9332025-01-28T23:04:31.843ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
9342025-01-28T23:04:31.843ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
9352025-01-28T23:04:31.843ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095", TimeNotSynchronized), ("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d", TimeNotSynchronized), ("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b", TimeNotSynchronized), ("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7", TimeNotSynchronized), ("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 109389 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59542 req_id = 2f7d4328-99ad-4a5d-a0ec-52e60c70e22f response_code = 500 uri = /omicron-zones
9362025-01-28T23:04:31.843ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2f7d4328-99ad-4a5d-a0ec-52e60c70e22f", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:31 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2f7d4328-99ad-4a5d-a0ec-52e60c70e22f" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 142.957823ms sled_address = [fd00:1122:3344:101::1]:12345
9372025-01-28T23:04:31.987ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: dae4f93f-35ac-4030-9420-e14e5ea8d9ee (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b7d629c3-43a9-4371-ba4a-bc36f41a62f9 (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 70effdad-f00a-4794-9092-69663f1aeca2 (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: de55335f-5cf0-42da-a609-77d7ebc1083e (service), filesystem_pool: Some(ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4b02f0f0-df74-4f61-b20c-210e6f4218f7, kind: Service { id: de55335f-5cf0-42da-a609-77d7ebc1083e }, name: Name("ntp-de55335f-5cf0-42da-a609-77d7ebc1083e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 131])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 6b033680-49cf-4495-a0e0-056bbe4ab095 (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: d0d250fe-36e3-4ca5-bd85-9b908c11378d (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } } } }, OmicronZoneConfig { id: 17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53b89418-4718-43ca-90c2-94f5822e6fc7 (service), filesystem_pool: Some(ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External } } } }, OmicronZoneConfig { id: c08aa32b-a2d1-49e8-bcd1-2e087a63170b (service), filesystem_pool: Some(ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9382025-01-28T23:04:31.987ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9392025-01-28T23:04:31.987ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9402025-01-28T23:04:31.996ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9412025-01-28T23:04:31.997ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9422025-01-28T23:04:32.005ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9432025-01-28T23:04:32.005ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9442025-01-28T23:04:32.015ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9452025-01-28T23:04:32.015ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9462025-01-28T23:04:32.024ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9472025-01-28T23:04:32.024ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9482025-01-28T23:04:32.032ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9492025-01-28T23:04:32.032ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9502025-01-28T23:04:32.040ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9512025-01-28T23:04:32.040ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9522025-01-28T23:04:32.048ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9532025-01-28T23:04:32.048ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9542025-01-28T23:04:32.056ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9552025-01-28T23:04:32.056ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
9562025-01-28T23:04:32.057ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
9572025-01-28T23:04:32.057ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9582025-01-28T23:04:32.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9592025-01-28T23:04:32.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9602025-01-28T23:04:32.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9612025-01-28T23:04:32.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9622025-01-28T23:04:32.137ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9632025-01-28T23:04:32.233ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095 file = illumos-utils/src/zone.rs:325
9642025-01-28T23:04:32.237ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d file = illumos-utils/src/zone.rs:325
9652025-01-28T23:04:32.242ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b file = illumos-utils/src/zone.rs:325
9662025-01-28T23:04:32.246ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7 file = illumos-utils/src/zone.rs:325
9672025-01-28T23:04:32.251ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b file = illumos-utils/src/zone.rs:325
9682025-01-28T23:04:32.256ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095 file = illumos-utils/src/zone.rs:363
9692025-01-28T23:04:32.261ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d file = illumos-utils/src/zone.rs:363
9702025-01-28T23:04:32.266ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b file = illumos-utils/src/zone.rs:363
9712025-01-28T23:04:32.271ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7 file = illumos-utils/src/zone.rs:363
9722025-01-28T23:04:32.275ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b file = illumos-utils/src/zone.rs:363
9732025-01-28T23:04:35.195ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d0d250fe-36e3-4ca5-bd85-9b908c11378d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9742025-01-28T23:04:35.195ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='6b033680-49cf-4495-a0e0-056bbe4ab095'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9752025-01-28T23:04:35.195ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
9762025-01-28T23:04:35.201ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
9772025-01-28T23:04:35.210ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9782025-01-28T23:04:35.210ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
9792025-01-28T23:04:35.215ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='53b89418-4718-43ca-90c2-94f5822e6fc7'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9802025-01-28T23:04:35.215ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
9812025-01-28T23:04:35.295ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c08aa32b-a2d1-49e8-bcd1-2e087a63170b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9822025-01-28T23:04:35.295ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
9832025-01-28T23:04:35.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 54.688386ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
9842025-01-28T23:04:35.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 67.119176ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
9852025-01-28T23:04:35.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 57.900063ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
9862025-01-28T23:04:35.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 62.003191ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
9872025-01-28T23:04:35.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 71.827872ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
9882025-01-28T23:04:35.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 78.262655ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
9892025-01-28T23:04:35.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 44.791727ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
9902025-01-28T23:04:36.059ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 80.540774ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
9912025-01-28T23:04:36.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 230.700749ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
9922025-01-28T23:04:36.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 193.676447ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
9932025-01-28T23:04:36.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 120.186762ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
9942025-01-28T23:04:36.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 50.545541ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
9952025-01-28T23:04:36.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 109.376602ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
9962025-01-28T23:04:36.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 364.802192ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
9972025-01-28T23:04:36.744ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 110.567755ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
9982025-01-28T23:04:36.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 172.224505ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
9992025-01-28T23:04:36.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 382.439973ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10002025-01-28T23:04:36.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 549.087093ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10012025-01-28T23:04:36.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 395.561381ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10022025-01-28T23:04:36.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 545.588408ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10032025-01-28T23:04:37.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 589.951248ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
10042025-01-28T23:04:37.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 561.296002ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10052025-01-28T23:04:37.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 500.742787ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10062025-01-28T23:04:37.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 533.815238ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10072025-01-28T23:04:37.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 766.096035ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10082025-01-28T23:04:37.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 1.307978707s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
10092025-01-28T23:04:37.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 922.789783ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10102025-01-28T23:04:37.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 767.272955ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10112025-01-28T23:04:37.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 507.799891ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10122025-01-28T23:04:38.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 1.187246781s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10132025-01-28T23:04:38.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 1.473247401s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10142025-01-28T23:04:38.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 772.494954ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10152025-01-28T23:04:38.726ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 1.332428939s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10162025-01-28T23:04:39.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 1.122202991s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
10172025-01-28T23:04:39.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 896.918781ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10182025-01-28T23:04:39.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 720.310062ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10192025-01-28T23:04:39.880ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60470
10202025-01-28T23:04:39.880ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60470 req_id = 1591bd0c-5a19-46b5-924d-5fb559d516b5 response_code = 200 uri = /baseboard
10212025-01-28T23:04:39.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 1.014188553s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10222025-01-28T23:04:40.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 671.298285ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10232025-01-28T23:04:40.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 805.81421ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
10242025-01-28T23:04:40.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 822.983882ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10252025-01-28T23:04:40.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 1.177238107s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10262025-01-28T23:04:40.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 956.012513ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10272025-01-28T23:04:40.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 1.200599289s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10282025-01-28T23:04:41.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 1.365335356s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
10292025-01-28T23:04:41.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 1.046727129s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10302025-01-28T23:04:41.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 664.629431ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10312025-01-28T23:04:41.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 905.232448ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10322025-01-28T23:04:42.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 744.962168ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10332025-01-28T23:04:42.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 1.009089046s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10342025-01-28T23:04:42.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 798.55677ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10352025-01-28T23:04:42.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 1.249460365s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
10362025-01-28T23:04:42.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 880.887115ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10372025-01-28T23:04:42.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 689.666395ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10382025-01-28T23:04:43.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 1.243192967s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10392025-01-28T23:04:43.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 1.235951177s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10402025-01-28T23:04:43.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 507.251461ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10412025-01-28T23:04:43.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 1.286973781s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10422025-01-28T23:04:43.633ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 866.075375ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
10432025-01-28T23:04:44.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b") failed: Property not found. retry in 1.414382148s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10442025-01-28T23:04:44.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095") failed: Property not found. retry in 961.844474ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10452025-01-28T23:04:44.417ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b") failed: Property not found. retry in 840.984115ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10462025-01-28T23:04:44.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d") failed: Property not found. retry in 1.395934294s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
10472025-01-28T23:04:44.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7") failed: Property not found. retry in 1.424457991s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10482025-01-28T23:04:46.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_c08aa32b-a2d1-49e8-bcd1-2e087a63170b
10492025-01-28T23:04:46.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_6b033680-49cf-4495-a0e0-056bbe4ab095
10502025-01-28T23:04:46.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_d0d250fe-36e3-4ca5-bd85-9b908c11378d
10512025-01-28T23:04:46.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b
10522025-01-28T23:04:46.345ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_53b89418-4718-43ca-90c2-94f5822e6fc7
10532025-01-28T23:04:46.345ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10542025-01-28T23:04:46.345ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10552025-01-28T23:04:46.346ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 14335931 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59542 req_id = a716cd2a-cbef-401c-bcf1-a4dbc0f35eda response_code = 204 uri = /omicron-zones
10562025-01-28T23:04:46.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62471
10572025-01-28T23:04:46.406ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27781 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = d6b0310f-3e0d-46aa-8e68-4c1b5bc6e438 response_code = 500 uri = /cockroachdb
10582025-01-28T23:04:46.406ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d6b0310f-3e0d-46aa-8e68-4c1b5bc6e438", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d6b0310f-3e0d-46aa-8e68-4c1b5bc6e438" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 146.104551ms
10592025-01-28T23:04:46.580ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26728 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = b06fa3fe-c18e-4107-bf04-b7e9eef24325 response_code = 500 uri = /cockroachdb
10602025-01-28T23:04:46.580ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "b06fa3fe-c18e-4107-bf04-b7e9eef24325", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "b06fa3fe-c18e-4107-bf04-b7e9eef24325" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 85.517514ms
10612025-01-28T23:04:46.694ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27422 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = f8149685-c496-429f-824e-8c9e49aa70f5 response_code = 500 uri = /cockroachdb
10622025-01-28T23:04:46.695ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f8149685-c496-429f-824e-8c9e49aa70f5", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f8149685-c496-429f-824e-8c9e49aa70f5" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 210.330867ms
10632025-01-28T23:04:46.931ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25448 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = cad37b39-f948-44c5-8581-f097131eb380 response_code = 500 uri = /cockroachdb
10642025-01-28T23:04:46.931ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cad37b39-f948-44c5-8581-f097131eb380", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cad37b39-f948-44c5-8581-f097131eb380" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 233.212476ms
10652025-01-28T23:04:47.191ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25603 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = bf9b2cb4-716a-40f7-9ff6-ab739fb4b762 response_code = 500 uri = /cockroachdb
10662025-01-28T23:04:47.191ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "bf9b2cb4-716a-40f7-9ff6-ab739fb4b762", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "bf9b2cb4-716a-40f7-9ff6-ab739fb4b762" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 222.833243ms
10672025-01-28T23:04:47.443ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = 8b347d20-f962-4ca5-b11f-418218a82bc6 response_code = 500 uri = /cockroachdb
10682025-01-28T23:04:47.443ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8b347d20-f962-4ca5-b11f-418218a82bc6", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8b347d20-f962-4ca5-b11f-418218a82bc6" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 324.095178ms
10692025-01-28T23:04:47.795ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = 6b8d00dc-e6f6-4d53-b648-6477745d7303 response_code = 500 uri = /cockroachdb
10702025-01-28T23:04:47.796ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6b8d00dc-e6f6-4d53-b648-6477745d7303", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6b8d00dc-e6f6-4d53-b648-6477745d7303" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 410.138843ms
10712025-01-28T23:04:48.233ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26615 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = a00bc237-949b-4c29-9025-c70dfcd4111d response_code = 500 uri = /cockroachdb
10722025-01-28T23:04:48.234ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a00bc237-949b-4c29-9025-c70dfcd4111d", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a00bc237-949b-4c29-9025-c70dfcd4111d" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 521.478542ms
10732025-01-28T23:04:48.330ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 359.843892ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
10742025-01-28T23:04:48.782ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25692 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = 27a9d7e6-5607-4fc8-8242-7ddec035a0ce response_code = 500 uri = /cockroachdb
10752025-01-28T23:04:48.782ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "27a9d7e6-5607-4fc8-8242-7ddec035a0ce", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "27a9d7e6-5607-4fc8-8242-7ddec035a0ce" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 231.108089ms
10762025-01-28T23:04:49.041ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService7/omicron6 in oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b /usr/sbin/ipadm show-addr -p -o ADDR oxControlService7/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26262 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = e84bed47-bf32-4b53-8e63-2a8213d57a8a response_code = 500 uri = /cockroachdb
10772025-01-28T23:04:49.041ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e84bed47-bf32-4b53-8e63-2a8213d57a8a", "content-length": "124", "date": "Tue, 28 Jan 2025 23:04:48 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e84bed47-bf32-4b53-8e63-2a8213d57a8a" } file = sled-agent/src/rack_setup/service.rs:1149 retry_after = 689.730913ms
10782025-01-28T23:04:49.765ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3752
10792025-01-28T23:05:05.137ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10802025-01-28T23:05:15.494ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10812025-01-28T23:05:15.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 25759528 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:62471 req_id = 91d9aff3-0f4c-4839-af83-a2b37f381928 response_code = 204 uri = /cockroachdb
10822025-01-28T23:05:15.494ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46982
10832025-01-28T23:05:15.494ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46982 req_id = 4a0593a0-c01d-466f-ac40-fc6f18daf818 response_code = 200 uri = /baseboard
10842025-01-28T23:05:15.498ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 715.361953ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
10852025-01-28T23:05:15.528ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: dae4f93f-35ac-4030-9420-e14e5ea8d9ee (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b7d629c3-43a9-4371-ba4a-bc36f41a62f9 (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 70effdad-f00a-4794-9092-69663f1aeca2 (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: de55335f-5cf0-42da-a609-77d7ebc1083e (service), filesystem_pool: Some(ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 4b02f0f0-df74-4f61-b20c-210e6f4218f7, kind: Service { id: de55335f-5cf0-42da-a609-77d7ebc1083e }, name: Name("ntp-de55335f-5cf0-42da-a609-77d7ebc1083e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 140, 131])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 6b033680-49cf-4495-a0e0-056bbe4ab095 (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: d0d250fe-36e3-4ca5-bd85-9b908c11378d (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } } } }, OmicronZoneConfig { id: 17d0023e-8fbe-47c8-9ed6-ed015c1d3b1b (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53b89418-4718-43ca-90c2-94f5822e6fc7 (service), filesystem_pool: Some(ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External } } } }, OmicronZoneConfig { id: c08aa32b-a2d1-49e8-bcd1-2e087a63170b (service), filesystem_pool: Some(ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External } } } }, OmicronZoneConfig { id: cc4afcc9-6153-4509-98bd-06bc1805f80c (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 4335af1f-16a7-49b3-8b71-d223b1685563 (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 (service), filesystem_pool: Some(ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e43f34ea-a717-45f9-a508-a556ea99a693 (service), filesystem_pool: Some(ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 04518a99-18ce-4d83-86ed-64c06a57b07c (service), filesystem_pool: Some(ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c44fa74f-7041-4d63-81a9-1a3711d05b88 (service), filesystem_pool: Some(ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 12456afa-742e-4f54-8877-0cd0b20e832b (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 15552f73-7650-4425-91ff-0f32a85da654 (service), filesystem_pool: Some(ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: dcc8e376-2b30-488c-9e20-ead28ff2c41c (service), filesystem_pool: Some(ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 3411516b-163a-4076-b319-c62078805732 (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 7ea1f3e4-2cbc-49d7-8176-eef30d8d4501 (service), filesystem_pool: Some(ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5135274c-11e4-49d7-bac9-3232786fb490 (service), filesystem_pool: Some(ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External } } } }, OmicronZoneConfig { id: fae6c26a-e6f7-4cd3-b6b0-99068a244306 (service), filesystem_pool: Some(ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External } } } }, OmicronZoneConfig { id: 66ab6032-c613-4d07-ba88-c2c852d0f0e4 (service), filesystem_pool: Some(ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5c7dc20f-f680-4f52-8af3-4fdc8868f90b (service), filesystem_pool: Some(ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External } } } }, OmicronZoneConfig { id: 781de651-fbde-4c6e-a9d7-794158a5c156 (service), filesystem_pool: Some(ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External } } } }, OmicronZoneConfig { id: dab85607-5cf7-4204-a98a-5c315f1fd285 (service), filesystem_pool: Some(ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External } } } }, OmicronZoneConfig { id: bf96545b-7915-4d1f-b507-82e98c226b38 (service), filesystem_pool: Some(ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5bcc7744-74d6-460c-911f-5891b9622ce9 (service), filesystem_pool: Some(ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10862025-01-28T23:05:15.529ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40064
10872025-01-28T23:05:15.529ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10882025-01-28T23:05:15.529ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10892025-01-28T23:05:15.541ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10902025-01-28T23:05:15.541ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10912025-01-28T23:05:15.552ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10922025-01-28T23:05:15.552ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10932025-01-28T23:05:15.563ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10942025-01-28T23:05:15.563ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10952025-01-28T23:05:15.573ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10962025-01-28T23:05:15.573ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10972025-01-28T23:05:15.582ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10982025-01-28T23:05:15.582ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10992025-01-28T23:05:15.592ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11002025-01-28T23:05:15.592ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11012025-01-28T23:05:15.603ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11022025-01-28T23:05:15.603ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11032025-01-28T23:05:15.612ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11042025-01-28T23:05:15.612ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11052025-01-28T23:05:15.624ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11062025-01-28T23:05:15.624ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11072025-01-28T23:05:15.634ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11082025-01-28T23:05:15.634ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11092025-01-28T23:05:15.645ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11102025-01-28T23:05:15.645ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, kind: Crucible }, responder: ... }
11112025-01-28T23:05:15.656ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11122025-01-28T23:05:15.656ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, kind: Crucible }, responder: ... }
11132025-01-28T23:05:15.666ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11142025-01-28T23:05:15.666ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, kind: Crucible }, responder: ... }
11152025-01-28T23:05:15.677ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11162025-01-28T23:05:15.677ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, kind: Crucible }, responder: ... }
11172025-01-28T23:05:15.686ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11182025-01-28T23:05:15.686ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, kind: Crucible }, responder: ... }
11192025-01-28T23:05:15.696ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11202025-01-28T23:05:15.696ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, kind: Crucible }, responder: ... }
11212025-01-28T23:05:15.706ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11222025-01-28T23:05:15.706ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, kind: Crucible }, responder: ... }
11232025-01-28T23:05:15.716ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11242025-01-28T23:05:15.716ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, kind: Crucible }, responder: ... }
11252025-01-28T23:05:15.728ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11262025-01-28T23:05:15.728ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, kind: Crucible }, responder: ... }
11272025-01-28T23:05:15.739ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11282025-01-28T23:05:15.739ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
11292025-01-28T23:05:15.739ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
11302025-01-28T23:05:15.740ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11312025-01-28T23:05:15.854ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11322025-01-28T23:05:15.893ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11332025-01-28T23:05:15.893ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11342025-01-28T23:05:15.893ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11352025-01-28T23:05:15.893ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11362025-01-28T23:05:15.894ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11372025-01-28T23:05:15.896ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11382025-01-28T23:05:15.908ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11392025-01-28T23:05:15.909ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11402025-01-28T23:05:15.922ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11412025-01-28T23:05:16.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11422025-01-28T23:05:16.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11432025-01-28T23:05:16.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11442025-01-28T23:05:16.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11452025-01-28T23:05:16.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11462025-01-28T23:05:16.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11472025-01-28T23:05:16.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11482025-01-28T23:05:16.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11492025-01-28T23:05:16.109ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11502025-01-28T23:05:16.110ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306 file = illumos-utils/src/zone.rs:325
11512025-01-28T23:05:16.115ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285 file = illumos-utils/src/zone.rs:325
11522025-01-28T23:05:16.119ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501 file = illumos-utils/src/zone.rs:325
11532025-01-28T23:05:16.125ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88 file = illumos-utils/src/zone.rs:325
11542025-01-28T23:05:16.130ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b file = illumos-utils/src/zone.rs:325
11552025-01-28T23:05:16.322ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306 file = illumos-utils/src/zone.rs:363
11562025-01-28T23:05:16.327ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285 file = illumos-utils/src/zone.rs:363
11572025-01-28T23:05:16.333ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501 file = illumos-utils/src/zone.rs:363
11582025-01-28T23:05:16.339ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88 file = illumos-utils/src/zone.rs:363
11592025-01-28T23:05:16.345ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b file = illumos-utils/src/zone.rs:363
11602025-01-28T23:05:16.350ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654 file = illumos-utils/src/zone.rs:325
11612025-01-28T23:05:16.355ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4 file = illumos-utils/src/zone.rs:325
11622025-01-28T23:05:16.360ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38 file = illumos-utils/src/zone.rs:325
11632025-01-28T23:05:16.366ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b file = illumos-utils/src/zone.rs:325
11642025-01-28T23:05:16.372ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c file = illumos-utils/src/zone.rs:325
11652025-01-28T23:05:16.377ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490 file = illumos-utils/src/zone.rs:325
11662025-01-28T23:05:16.384ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732 file = illumos-utils/src/zone.rs:325
11672025-01-28T23:05:16.391ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156 file = illumos-utils/src/zone.rs:325
11682025-01-28T23:05:16.448ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11692025-01-28T23:05:16.448ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654 file = illumos-utils/src/zone.rs:363
11702025-01-28T23:05:16.459ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4 file = illumos-utils/src/zone.rs:363
11712025-01-28T23:05:16.478ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38 file = illumos-utils/src/zone.rs:363
11722025-01-28T23:05:16.491ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b file = illumos-utils/src/zone.rs:363
11732025-01-28T23:05:16.508ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c file = illumos-utils/src/zone.rs:363
11742025-01-28T23:05:16.518ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490 file = illumos-utils/src/zone.rs:363
11752025-01-28T23:05:16.525ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732 file = illumos-utils/src/zone.rs:363
11762025-01-28T23:05:16.535ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156 file = illumos-utils/src/zone.rs:363
11772025-01-28T23:05:16.544ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9 file = illumos-utils/src/zone.rs:325
11782025-01-28T23:05:16.607ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11792025-01-28T23:05:16.665ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11802025-01-28T23:05:16.722ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11812025-01-28T23:05:16.723ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9 file = illumos-utils/src/zone.rs:363
11822025-01-28T23:05:16.795ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11832025-01-28T23:05:16.798ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11842025-01-28T23:05:16.798ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11852025-01-28T23:05:16.855ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 173, 192]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11862025-01-28T23:05:16.855ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11872025-01-28T23:05:16.858ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11882025-01-28T23:05:16.858ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11892025-01-28T23:05:16.914ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 156, 236]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11902025-01-28T23:05:16.914ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11912025-01-28T23:05:16.916ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11922025-01-28T23:05:16.916ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11932025-01-28T23:05:16.972ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 133, 61]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11942025-01-28T23:05:16.972ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11952025-01-28T23:05:16.974ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11962025-01-28T23:05:16.974ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11972025-01-28T23:05:17.035ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 205, 252]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11982025-01-28T23:05:17.035ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
11992025-01-28T23:05:17.037ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12002025-01-28T23:05:17.037ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12012025-01-28T23:05:17.090ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 253, 210]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12022025-01-28T23:05:17.090ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12032025-01-28T23:05:17.090ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
12042025-01-28T23:05:17.090ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
12052025-01-28T23:05:17.090ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
12062025-01-28T23:05:17.090ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
12072025-01-28T23:05:17.090ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
12082025-01-28T23:05:17.090ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
12092025-01-28T23:05:17.090ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
12102025-01-28T23:05:17.090ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
12112025-01-28T23:05:17.091ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12122025-01-28T23:05:17.091ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12132025-01-28T23:05:17.092ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
12142025-01-28T23:05:17.093ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
12152025-01-28T23:05:17.095ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
12162025-01-28T23:05:17.095ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12172025-01-28T23:05:17.095ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12182025-01-28T23:05:17.098ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
12192025-01-28T23:05:17.100ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
12202025-01-28T23:05:17.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212025-01-28T23:05:17.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12222025-01-28T23:05:17.102ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12232025-01-28T23:05:17.340ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563 file = illumos-utils/src/zone.rs:325
12242025-01-28T23:05:17.354ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693 file = illumos-utils/src/zone.rs:325
12252025-01-28T23:05:17.370ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600 file = illumos-utils/src/zone.rs:325
12262025-01-28T23:05:17.389ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c file = illumos-utils/src/zone.rs:325
12272025-01-28T23:05:17.405ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c file = illumos-utils/src/zone.rs:325
12282025-01-28T23:05:17.416ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563 file = illumos-utils/src/zone.rs:363
12292025-01-28T23:05:17.428ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693 file = illumos-utils/src/zone.rs:363
12302025-01-28T23:05:17.443ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600 file = illumos-utils/src/zone.rs:363
12312025-01-28T23:05:17.456ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c file = illumos-utils/src/zone.rs:363
12322025-01-28T23:05:17.472ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c file = illumos-utils/src/zone.rs:363
12332025-01-28T23:05:19.537ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_099773d5-5f69-4f65-8f86-75c48d557e90/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='dfb69ba9-6896-474b-9a25-e25e6e589b3d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12342025-01-28T23:05:19.537ZINFOSledAgent (ServiceManager): Booting oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
12352025-01-28T23:05:19.578ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12362025-01-28T23:05:19.578ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
12372025-01-28T23:05:19.618ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_21294dfd-a58f-42c6-a41c-8b148c95a198/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1e1b1378-11a7-459f-bcb2-a3d038748e2d'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12382025-01-28T23:05:19.619ZINFOSledAgent (ServiceManager): Booting oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
12392025-01-28T23:05:19.677ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b6f4a7de-ae5d-4497-bee3-21826d504667/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4d9803ed-e955-4c63-829a-662b4eb231e4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12402025-01-28T23:05:19.678ZINFOSledAgent (ServiceManager): Booting oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
12412025-01-28T23:05:19.719ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_ff6949fe-2851-437a-b6e9-cb91f2325920/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8affafa7-8cef-43a6-aa8e-7456fadabbf2'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12422025-01-28T23:05:19.719ZINFOSledAgent (ServiceManager): Booting oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
12432025-01-28T23:05:19.738ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='947d788a-1eee-4f40-ba92-f85e5a8b6fc6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12442025-01-28T23:05:19.738ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
12452025-01-28T23:05:19.831ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='c44fa74f-7041-4d63-81a9-1a3711d05b88'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12462025-01-28T23:05:19.831ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
12472025-01-28T23:05:19.954ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ae6506fb-18b0-4399-b1c7-3217131545c1'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12482025-01-28T23:05:19.955ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
12492025-01-28T23:05:20.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 57.238507ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
12502025-01-28T23:05:20.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 40.809774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
12512025-01-28T23:05:20.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 29.442547ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
12522025-01-28T23:05:20.183ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 55.020801ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
12532025-01-28T23:05:20.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 27.418159ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
12542025-01-28T23:05:20.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 103.600063ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
12552025-01-28T23:05:20.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 126.461995ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
12562025-01-28T23:05:20.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 59.663994ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
12572025-01-28T23:05:20.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 226.516684ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
12582025-01-28T23:05:20.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 73.177231ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
12592025-01-28T23:05:20.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 107.575464ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
12602025-01-28T23:05:20.643ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 89.234355ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
12612025-01-28T23:05:20.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 28.90153ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
12622025-01-28T23:05:21.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 172.231164ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
12632025-01-28T23:05:22.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 37.704895ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
12642025-01-28T23:05:22.020ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_79dc877f-201a-4a6a-a185-dc64a57ed603/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9ed4c6dc-a156-4569-bf19-2a222c7bda48'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12652025-01-28T23:05:22.021ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12662025-01-28T23:05:22.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 538.929266ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
12672025-01-28T23:05:22.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 119.683682ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
12682025-01-28T23:05:22.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 107.64104ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
12692025-01-28T23:05:22.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 282.192429ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
12702025-01-28T23:05:22.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 159.498582ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
12712025-01-28T23:05:22.452ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 97.093957ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
12722025-01-28T23:05:22.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 406.776395ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
12732025-01-28T23:05:22.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 62.750526ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
12742025-01-28T23:05:22.501ZINFOSledAgent (ServiceManager): Booting oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
12752025-01-28T23:05:22.509ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
12762025-01-28T23:05:22.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 535.644496ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
12772025-01-28T23:05:22.545ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 111.638969ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
12782025-01-28T23:05:22.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 241.119517ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
12792025-01-28T23:05:22.563ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_46e85043-614f-4a55-8660-1ccd892d22b2/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='fc6234df-7943-4ab7-9916-65f877b3fd05'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12802025-01-28T23:05:22.564ZINFOSledAgent (ServiceManager): Booting oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
12812025-01-28T23:05:22.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 265.936609ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
12822025-01-28T23:05:22.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 356.133121ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
12832025-01-28T23:05:22.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 473.739958ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
12842025-01-28T23:05:22.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 391.444865ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
12852025-01-28T23:05:22.692ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12862025-01-28T23:05:22.692ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
12872025-01-28T23:05:22.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 455.84165ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
12882025-01-28T23:05:22.843ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 763.995948ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
12892025-01-28T23:05:22.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 25.730705ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
12902025-01-28T23:05:22.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 25.338523ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
12912025-01-28T23:05:22.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 72.986184ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
12922025-01-28T23:05:22.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 957.400365ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
12932025-01-28T23:05:22.921ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 211.281947ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
12942025-01-28T23:05:22.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 127.683908ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
12952025-01-28T23:05:22.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 85.435059ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
12962025-01-28T23:05:22.978ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 766.360142ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
12972025-01-28T23:05:22.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 127.616564ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
12982025-01-28T23:05:23.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 61.427956ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
12992025-01-28T23:05:23.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 235.348836ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
13002025-01-28T23:05:23.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 206.516307ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
13012025-01-28T23:05:23.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 659.482486ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
13022025-01-28T23:05:23.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 147.566052ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
13032025-01-28T23:05:23.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 898.530703ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
13042025-01-28T23:05:23.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 120.274196ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
13052025-01-28T23:05:23.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 1.133241497s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
13062025-01-28T23:05:23.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 527.303936ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
13072025-01-28T23:05:23.228ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13082025-01-28T23:05:23.228ZINFOSledAgent (ServiceManager): Booting oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
13092025-01-28T23:05:23.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 245.29636ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
13102025-01-28T23:05:23.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 411.606386ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
13112025-01-28T23:05:23.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 366.4146ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
13122025-01-28T23:05:23.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 561.250259ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
13132025-01-28T23:05:23.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 858.3279ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
13142025-01-28T23:05:23.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 40.615819ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
13152025-01-28T23:05:23.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 325.949703ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
13162025-01-28T23:05:23.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 146.597549ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
13172025-01-28T23:05:23.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 1.240404544s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
13182025-01-28T23:05:23.656ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13192025-01-28T23:05:23.657ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
13202025-01-28T23:05:23.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 1.153602453s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
13212025-01-28T23:05:23.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 731.750902ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
13222025-01-28T23:05:23.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 1.355696718s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
13232025-01-28T23:05:23.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 265.499802ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
13242025-01-28T23:05:23.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 875.772341ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
13252025-01-28T23:05:23.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 719.877025ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
13262025-01-28T23:05:23.805ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_68044c5c-97c7-414c-b44a-b8251f523a8f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ba1d9890-0d54-4c90-9835-39bc0f3e39d9'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13272025-01-28T23:05:23.805ZINFOSledAgent (ServiceManager): Booting oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
13282025-01-28T23:05:23.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 708.077505ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
13292025-01-28T23:05:23.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 603.609257ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
13302025-01-28T23:05:23.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 928.82506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
13312025-01-28T23:05:23.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 32.960966ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
13322025-01-28T23:05:24.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 126.272284ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
13332025-01-28T23:05:24.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 750.521472ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
13342025-01-28T23:05:24.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 590.925037ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
13352025-01-28T23:05:24.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 159.590467ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
13362025-01-28T23:05:24.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 73.772583ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
13372025-01-28T23:05:24.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 1.333113976s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
13382025-01-28T23:05:24.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 90.672176ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
13392025-01-28T23:05:24.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 1.072011781s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
13402025-01-28T23:05:24.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 395.33202ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
13412025-01-28T23:05:24.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 286.237442ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
13422025-01-28T23:05:24.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 1.181456734s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
13432025-01-28T23:05:24.508ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 758.603784ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
13442025-01-28T23:05:24.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 1.436876913s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
13452025-01-28T23:05:24.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 733.128105ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
13462025-01-28T23:05:24.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 382.356042ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
13472025-01-28T23:05:24.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 904.706378ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
13482025-01-28T23:05:24.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 1.148778934s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
13492025-01-28T23:05:24.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 566.64642ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
13502025-01-28T23:05:24.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 570.174944ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
13512025-01-28T23:05:24.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 1.110449418s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
13522025-01-28T23:05:24.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 1.086774454s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
13532025-01-28T23:05:24.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 1.115326573s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
13542025-01-28T23:05:25.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 703.707042ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
13552025-01-28T23:05:25.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 956.329689ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
13562025-01-28T23:05:25.160ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13572025-01-28T23:05:25.160ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
13582025-01-28T23:05:25.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 1.236402178s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
13592025-01-28T23:05:25.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 1.489920442s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
13602025-01-28T23:05:25.384ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 747.311476ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
13612025-01-28T23:05:25.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 1.115980639s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
13622025-01-28T23:05:25.408ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13632025-01-28T23:05:25.408ZINFOSledAgent (ServiceManager): Booting oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
13642025-01-28T23:05:25.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 1.2782606s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
13652025-01-28T23:05:25.449ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13662025-01-28T23:05:25.449ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
13672025-01-28T23:05:25.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 572.369769ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
13682025-01-28T23:05:25.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 66.740502ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
13692025-01-28T23:05:25.613ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 1.399344296s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
13702025-01-28T23:05:25.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 126.768536ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
13712025-01-28T23:05:25.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 843.649967ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
13722025-01-28T23:05:25.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 628.483487ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
13732025-01-28T23:05:25.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 74.14427ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
13742025-01-28T23:05:25.846ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 192.60366ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
13752025-01-28T23:05:25.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 71.575326ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
13762025-01-28T23:05:25.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 86.069481ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
13772025-01-28T23:05:25.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 763.500869ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
13782025-01-28T23:05:26.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 743.670804ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
13792025-01-28T23:05:26.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 944.887425ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
13802025-01-28T23:05:26.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 139.559511ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
13812025-01-28T23:05:26.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 155.411482ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
13822025-01-28T23:05:26.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 1.078283991s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
13832025-01-28T23:05:26.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 227.359864ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
13842025-01-28T23:05:26.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 1.085361051s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
13852025-01-28T23:05:26.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 1.081298031s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
13862025-01-28T23:05:26.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 1.106605028s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
13872025-01-28T23:05:26.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 1.445185039s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
13882025-01-28T23:05:26.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 178.484567ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
13892025-01-28T23:05:26.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 505.915843ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
13902025-01-28T23:05:26.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 793.090062ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
13912025-01-28T23:05:26.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 604.945304ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
13922025-01-28T23:05:26.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 294.891286ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
13932025-01-28T23:05:26.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 1.095626161s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
13942025-01-28T23:05:26.565ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 1.070470398s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
13952025-01-28T23:05:26.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 775.30056ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
13962025-01-28T23:05:26.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 1.463206542s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
13972025-01-28T23:05:26.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 753.26091ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
13982025-01-28T23:05:26.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 838.884517ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
13992025-01-28T23:05:26.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 1.489986755s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
14002025-01-28T23:05:26.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 651.270868ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
14012025-01-28T23:05:26.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 619.010325ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
14022025-01-28T23:05:27.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 680.584281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
14032025-01-28T23:05:27.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 1.302055056s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
14042025-01-28T23:05:27.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 1.114396511s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
14052025-01-28T23:05:27.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 1.018222106s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
14062025-01-28T23:05:27.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 1.256637589s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
14072025-01-28T23:05:27.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 1.02425568s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
14082025-01-28T23:05:27.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 1.406166886s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
14092025-01-28T23:05:27.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 1.055040285s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
14102025-01-28T23:05:27.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 977.635583ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
14112025-01-28T23:05:27.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 1.284813256s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
14122025-01-28T23:05:27.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 635.693983ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
14132025-01-28T23:05:27.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 608.893451ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
14142025-01-28T23:05:27.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 1.259225541s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
14152025-01-28T23:05:27.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 521.030632ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
14162025-01-28T23:05:27.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 837.134624ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
14172025-01-28T23:05:27.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 1.10354039s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
14182025-01-28T23:05:27.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 982.6691ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
14192025-01-28T23:05:28.191ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 642.076224ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
14202025-01-28T23:05:28.204ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 551.050301ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
14212025-01-28T23:05:28.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 1.187742527s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
14222025-01-28T23:05:28.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 1.430657279s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
14232025-01-28T23:05:28.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 598.853251ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
14242025-01-28T23:05:28.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 539.138899ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
14252025-01-28T23:05:28.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 892.538991ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
14262025-01-28T23:05:28.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 1.22378129s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
14272025-01-28T23:05:28.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 1.023082683s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
14282025-01-28T23:05:28.418ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 562.133832ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
14292025-01-28T23:05:28.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 710.213512ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
14302025-01-28T23:05:28.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 1.288296445s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
14312025-01-28T23:05:28.548ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 1.488478312s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
14322025-01-28T23:05:28.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 788.809493ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
14332025-01-28T23:05:28.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 819.270431ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
14342025-01-28T23:05:28.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 1.045466624s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
14352025-01-28T23:05:28.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 978.715148ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
14362025-01-28T23:05:28.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 1.083363132s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
14372025-01-28T23:05:28.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 590.382238ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
14382025-01-28T23:05:28.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 794.893209ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
14392025-01-28T23:05:28.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 1.185057449s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
14402025-01-28T23:05:28.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 1.434970665s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
14412025-01-28T23:05:28.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 958.619246ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
14422025-01-28T23:05:29.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 1.100957963s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
14432025-01-28T23:05:29.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 721.242219ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
14442025-01-28T23:05:29.388ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14452025-01-28T23:05:29.389ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
14462025-01-28T23:05:29.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 659.991381ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
14472025-01-28T23:05:29.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 1.374008581s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
14482025-01-28T23:05:29.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 1.209134909s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
14492025-01-28T23:05:29.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 957.135602ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
14502025-01-28T23:05:29.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 1.198223552s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
14512025-01-28T23:05:29.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 1.239922026s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
14522025-01-28T23:05:29.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 49.322443ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
14532025-01-28T23:05:29.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 563.818536ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
14542025-01-28T23:05:29.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 616.846458ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
14552025-01-28T23:05:29.725ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 84.371383ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
14562025-01-28T23:05:29.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 828.139308ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
14572025-01-28T23:05:29.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 1.245439218s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
14582025-01-28T23:05:30.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 156.389746ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
14592025-01-28T23:05:30.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 1.257643554s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
14602025-01-28T23:05:30.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 603.783688ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
14612025-01-28T23:05:30.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 1.224693687s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
14622025-01-28T23:05:30.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 1.186326566s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
14632025-01-28T23:05:30.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 1.000748318s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
14642025-01-28T23:05:30.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 981.159527ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
14652025-01-28T23:05:30.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 887.796598ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
14662025-01-28T23:05:30.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 206.316145ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
14672025-01-28T23:05:30.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 1.141157583s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
14682025-01-28T23:05:30.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 1.453974046s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
14692025-01-28T23:05:30.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 1.012378297s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
14702025-01-28T23:05:30.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 801.523952ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
14712025-01-28T23:05:30.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 1.169123609s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
14722025-01-28T23:05:30.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 788.745263ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
14732025-01-28T23:05:30.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 823.213342ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
14742025-01-28T23:05:30.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 733.795237ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
14752025-01-28T23:05:30.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 1.305737013s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
14762025-01-28T23:05:30.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 900.91814ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
14772025-01-28T23:05:30.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 1.324007719s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
14782025-01-28T23:05:30.857ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 535.034549ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
14792025-01-28T23:05:31.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 1.426589943s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
14802025-01-28T23:05:31.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 1.474409459s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
14812025-01-28T23:05:31.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 1.4665776s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
14822025-01-28T23:05:31.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 986.182262ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
14832025-01-28T23:05:31.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 1.172317898s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
14842025-01-28T23:05:31.322ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.389116756s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
14852025-01-28T23:05:31.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 1.00923746s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
14862025-01-28T23:05:31.344ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 980.355452ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
14872025-01-28T23:05:31.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 926.069034ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
14882025-01-28T23:05:31.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 512.67758ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
14892025-01-28T23:05:31.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 1.192560449s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
14902025-01-28T23:05:31.403ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 979.635272ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
14912025-01-28T23:05:31.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 610.999488ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
14922025-01-28T23:05:31.465ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 1.139760612s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
14932025-01-28T23:05:31.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 788.424259ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
14942025-01-28T23:05:31.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 1.414173164s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
14952025-01-28T23:05:31.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 553.734416ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
14962025-01-28T23:05:31.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 1.433373297s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
14972025-01-28T23:05:31.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 1.007460139s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
14982025-01-28T23:05:32.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 715.258388ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
14992025-01-28T23:05:32.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 1.40068181s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
15002025-01-28T23:05:32.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 1.219448262s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
15012025-01-28T23:05:32.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 1.034369102s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
15022025-01-28T23:05:32.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 975.967494ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
15032025-01-28T23:05:32.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 760.191307ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
15042025-01-28T23:05:32.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 1.265952283s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
15052025-01-28T23:05:32.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 502.484534ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
15062025-01-28T23:05:32.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 688.633213ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
15072025-01-28T23:05:32.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 1.489133671s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
15082025-01-28T23:05:32.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 1.102445905s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
15092025-01-28T23:05:32.490ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 1.458272008s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
15102025-01-28T23:05:32.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 887.163079ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
15112025-01-28T23:05:32.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 613.111819ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
15122025-01-28T23:05:32.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 979.22174ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
15132025-01-28T23:05:32.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 1.028892718s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
15142025-01-28T23:05:32.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 820.082268ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
15152025-01-28T23:05:32.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 1.193629833s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
15162025-01-28T23:05:32.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 1.071084265s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
15172025-01-28T23:05:33.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 796.181546ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
15182025-01-28T23:05:33.052ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 1.271919187s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
15192025-01-28T23:05:33.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 966.623155ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
15202025-01-28T23:05:33.188ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 624.914668ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
15212025-01-28T23:05:33.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 801.368858ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
15222025-01-28T23:05:33.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 1.417155684s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
15232025-01-28T23:05:33.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 1.114096136s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
15242025-01-28T23:05:33.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 939.421058ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
15252025-01-28T23:05:33.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 650.000797ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
15262025-01-28T23:05:33.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 1.198472409s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
15272025-01-28T23:05:33.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 796.51145ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
15282025-01-28T23:05:33.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 725.518476ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
15292025-01-28T23:05:33.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 970.283588ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
15302025-01-28T23:05:33.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 1.213272672s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
15312025-01-28T23:05:33.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 1.377800256s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
15322025-01-28T23:05:33.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 1.33175481s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
15332025-01-28T23:05:33.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 958.660942ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
15342025-01-28T23:05:33.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 506.953625ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
15352025-01-28T23:05:33.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 934.617257ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
15362025-01-28T23:05:33.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 558.790668ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
15372025-01-28T23:05:34.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 775.179281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
15382025-01-28T23:05:34.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 883.117009ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
15392025-01-28T23:05:34.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 540.754704ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
15402025-01-28T23:05:34.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 682.6744ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
15412025-01-28T23:05:34.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 904.710263ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
15422025-01-28T23:05:34.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306") failed: Property not found. retry in 875.166812ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
15432025-01-28T23:05:34.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 1.265311131s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
15442025-01-28T23:05:34.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 1.147010206s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
15452025-01-28T23:05:34.387ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 1.106832043s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
15462025-01-28T23:05:34.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 531.381317ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
15472025-01-28T23:05:34.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 629.415501ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
15482025-01-28T23:05:34.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 830.085177ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
15492025-01-28T23:05:34.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490") failed: Property not found. retry in 1.367834185s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
15502025-01-28T23:05:34.672ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563") failed: Property not found. retry in 1.30371509s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
15512025-01-28T23:05:34.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 560.273161ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
15522025-01-28T23:05:34.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 1.123539692s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
15532025-01-28T23:05:34.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 751.582787ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
15542025-01-28T23:05:34.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 1.069460107s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
15552025-01-28T23:05:34.844ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 1.060007793s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
15562025-01-28T23:05:34.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 798.959335ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
15572025-01-28T23:05:34.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 827.988982ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
15582025-01-28T23:05:34.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38") failed: Property not found. retry in 1.057298823s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
15592025-01-28T23:05:35.062ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4") failed: Property not found. retry in 905.001753ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
15602025-01-28T23:05:35.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c") failed: Property not found. retry in 1.013597285s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
15612025-01-28T23:05:35.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 924.427222ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
15622025-01-28T23:05:35.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 624.176562ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
15632025-01-28T23:05:35.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 803.936318ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
15642025-01-28T23:05:35.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 1.071041109s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
15652025-01-28T23:05:35.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b") failed: Property not found. retry in 1.049834034s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
15662025-01-28T23:05:35.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 1.433600866s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
15672025-01-28T23:05:35.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 504.235196ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
15682025-01-28T23:05:35.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285") failed: Property not found. retry in 729.686958ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
15692025-01-28T23:05:35.713ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 1.356131863s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
15702025-01-28T23:05:35.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88") failed: Property not found. retry in 742.62029ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
15712025-01-28T23:05:35.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 552.067782ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
15722025-01-28T23:05:35.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 789.563082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
15732025-01-28T23:05:35.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9") failed: Property not found. retry in 605.382764ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
15742025-01-28T23:05:35.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 632.603229ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
15752025-01-28T23:05:36.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 965.624213ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
15762025-01-28T23:05:36.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 955.553495ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
15772025-01-28T23:05:36.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 1.138401157s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
15782025-01-28T23:05:36.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c") failed: Property not found. retry in 919.946015ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
15792025-01-28T23:05:36.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 1.439090099s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
15802025-01-28T23:05:36.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 564.128875ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
15812025-01-28T23:05:36.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 1.002096875s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
15822025-01-28T23:05:36.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 714.715783ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
15832025-01-28T23:05:37.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501") failed: Property not found. retry in 1.28265779s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
15842025-01-28T23:05:37.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 1.4530812s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
15852025-01-28T23:05:37.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732") failed: Property not found. retry in 1.185514761s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
15862025-01-28T23:05:37.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 666.176256ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
15872025-01-28T23:05:37.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156") failed: Property not found. retry in 1.25872279s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
15882025-01-28T23:05:37.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 1.453946269s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
15892025-01-28T23:05:37.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654") failed: Property not found. retry in 1.389145302s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
15902025-01-28T23:05:37.833ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 682.440363ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
15912025-01-28T23:05:37.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 1.073605403s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
15922025-01-28T23:05:38.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 1.445700492s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
15932025-01-28T23:05:38.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 1.322979041s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
15942025-01-28T23:05:39.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 674.079432ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
15952025-01-28T23:05:39.164ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 973.311241ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
15962025-01-28T23:05:39.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 678.752896ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
15972025-01-28T23:05:39.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 1.046889378s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
15982025-01-28T23:05:39.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 753.385824ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
15992025-01-28T23:05:40.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 611.952853ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
16002025-01-28T23:05:40.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 1.00540441s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
16012025-01-28T23:05:40.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 1.136218995s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
16022025-01-28T23:05:40.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 713.04326ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
16032025-01-28T23:05:40.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 1.470545967s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
16042025-01-28T23:05:41.445ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 588.153008ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
16052025-01-28T23:05:41.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600") failed: Property not found. retry in 1.214018628s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
16062025-01-28T23:05:41.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 773.890041ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
16072025-01-28T23:05:42.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c") failed: Property not found. retry in 1.256393038s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
16082025-01-28T23:05:42.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693") failed: Property not found. retry in 1.171300476s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
16092025-01-28T23:05:42.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 983.015005ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
16102025-01-28T23:05:43.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b") failed: Property not found. retry in 988.234424ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
16112025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_4335af1f-16a7-49b3-8b71-d223b1685563
16122025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_fae6c26a-e6f7-4cd3-b6b0-99068a244306
16132025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_dab85607-5cf7-4204-a98a-5c315f1fd285
16142025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_7ea1f3e4-2cbc-49d7-8176-eef30d8d4501
16152025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_e43f34ea-a717-45f9-a508-a556ea99a693
16162025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_69eeab44-9aa8-404e-a0e1-08c536dc6600
16172025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_04518a99-18ce-4d83-86ed-64c06a57b07c
16182025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_c44fa74f-7041-4d63-81a9-1a3711d05b88
16192025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_cc4afcc9-6153-4509-98bd-06bc1805f80c
16202025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_12456afa-742e-4f54-8877-0cd0b20e832b
16212025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_15552f73-7650-4425-91ff-0f32a85da654
16222025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_66ab6032-c613-4d07-ba88-c2c852d0f0e4
16232025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_bf96545b-7915-4d1f-b507-82e98c226b38
16242025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_5c7dc20f-f680-4f52-8af3-4fdc8868f90b
16252025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_dcc8e376-2b30-488c-9e20-ead28ff2c41c
16262025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_5135274c-11e4-49d7-bac9-3232786fb490
16272025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_3411516b-163a-4076-b319-c62078805732
16282025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_781de651-fbde-4c6e-a9d7-794158a5c156
16292025-01-28T23:05:44.695ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_5bcc7744-74d6-460c-911f-5891b9622ce9
16302025-01-28T23:05:44.696ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16312025-01-28T23:05:44.698ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16322025-01-28T23:05:44.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29206257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40064 req_id = 80d4c2ca-47d6-4843-badc-36904be0adff response_code = 204 uri = /omicron-zones
16332025-01-28T23:05:44.750ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1406
16342025-01-28T23:05:44.753ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16352025-01-28T23:05:44.760ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:803
16362025-01-28T23:05:44.799ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1008
16372025-01-28T23:05:44.802ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16382025-01-28T23:05:44.946ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16392025-01-28T23:05:45.104ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16402025-01-28T23:05:45.300ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16412025-01-28T23:05:45.542ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32964
16422025-01-28T23:05:45.544ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 469 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:32964 req_id = e9d63071-3258-45e4-940f-8f66e96a5377 response_code = 200 uri = /baseboard
16432025-01-28T23:05:45.547ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16442025-01-28T23:05:45.818ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16452025-01-28T23:05:46.187ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16462025-01-28T23:05:46.349ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16472025-01-28T23:05:46.736ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16482025-01-28T23:05:47.144ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16492025-01-28T23:05:47.611ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16502025-01-28T23:05:47.761ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.32113639s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
16512025-01-28T23:05:48.398ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16522025-01-28T23:05:49.078ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16532025-01-28T23:05:49.692ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/1dd1bac0-1736-4ceb-85ab-0435e21b8ce6/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1070
16542025-01-28T23:05:51.857ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0991485d-f80e-4c9a-bf36-8f41452bf4ad", "content-length": "173", "date": "Tue, 28 Jan 2025 23:05:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"1dd1bac0-1736-4ceb-85ab-0435e21b8ce6\"", request_id: "0991485d-f80e-4c9a-bf36-8f41452bf4ad" } file = sled-agent/src/rack_setup/service.rs:1070
16552025-01-28T23:05:54.585ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "15f74ff7-6032-4602-b7a3-55d834ac177c", "content-length": "173", "date": "Tue, 28 Jan 2025 23:05:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "15f74ff7-6032-4602-b7a3-55d834ac177c" } file = sled-agent/src/rack_setup/service.rs:1070
16562025-01-28T23:05:56.406ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ac0c77b1-29a1-471f-8b21-fef10ab6c023", "content-length": "173", "date": "Tue, 28 Jan 2025 23:05:56 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "ac0c77b1-29a1-471f-8b21-fef10ab6c023" } file = sled-agent/src/rack_setup/service.rs:1070
16572025-01-28T23:05:58.965ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3a0c39ab-c794-40a6-9fe0-8f2d92d85aed", "content-length": "173", "date": "Tue, 28 Jan 2025 23:05:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "3a0c39ab-c794-40a6-9fe0-8f2d92d85aed" } file = sled-agent/src/rack_setup/service.rs:1070
16582025-01-28T23:06:01.242ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f074c00a-458a-4051-8d0d-f5ed7369f3ac", "content-length": "173", "date": "Tue, 28 Jan 2025 23:06:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "f074c00a-458a-4051-8d0d-f5ed7369f3ac" } file = sled-agent/src/rack_setup/service.rs:1070
16592025-01-28T23:06:03.701ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "810fff62-4dd4-4f01-bff6-a029ab4a1d10", "content-length": "173", "date": "Tue, 28 Jan 2025 23:06:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "810fff62-4dd4-4f01-bff6-a029ab4a1d10" } file = sled-agent/src/rack_setup/service.rs:1070
16602025-01-28T23:06:08.036ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "822275c2-d7e5-4ff4-b28e-feff8b32d296", "content-length": "173", "date": "Tue, 28 Jan 2025 23:06:07 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "822275c2-d7e5-4ff4-b28e-feff8b32d296" } file = sled-agent/src/rack_setup/service.rs:1070
16612025-01-28T23:06:11.391ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "10dd25fd-df6b-41d0-948d-5debe50bcb80", "content-length": "173", "date": "Tue, 28 Jan 2025 23:06:10 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "10dd25fd-df6b-41d0-948d-5debe50bcb80" } file = sled-agent/src/rack_setup/service.rs:1070
16622025-01-28T23:06:14.363ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "95c41d3d-50ad-4b77-8059-e7686da8543f", "content-length": "173", "date": "Tue, 28 Jan 2025 23:06:14 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "95c41d3d-50ad-4b77-8059-e7686da8543f" } file = sled-agent/src/rack_setup/service.rs:1070
16632025-01-28T23:06:15.581ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65222
16642025-01-28T23:06:15.581ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65222 req_id = 74204961-644f-48b2-a831-5cc7ef918a6a response_code = 200 uri = /baseboard
16652025-01-28T23:06:21.822ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e8fe36ce-ac5e-4ab9-bbdd-933e38bc38d2", "content-length": "173", "date": "Tue, 28 Jan 2025 23:06:21 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "e8fe36ce-ac5e-4ab9-bbdd-933e38bc38d2" } file = sled-agent/src/rack_setup/service.rs:1070
16662025-01-28T23:06:27.385ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "254c5d79-f0bf-4ffb-b2b3-8d4b5177976f", "content-length": "173", "date": "Tue, 28 Jan 2025 23:06:27 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"333ba0f0-e056-439e-a4d5-a88dac7ac1cc\"", request_id: "254c5d79-f0bf-4ffb-b2b3-8d4b5177976f" } file = sled-agent/src/rack_setup/service.rs:1070
16672025-01-28T23:06:34.290ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
16682025-01-28T23:06:34.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47528
16692025-01-28T23:06:34.503ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16702025-01-28T23:06:34.503ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16712025-01-28T23:06:34.503ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
16722025-01-28T23:06:34.503ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
16732025-01-28T23:06:34.515ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16742025-01-28T23:06:34.516ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68044c5c-97c7-414c-b44a-b8251f523a8f
16752025-01-28T23:06:34.540ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16762025-01-28T23:06:34.540ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_099773d5-5f69-4f65-8f86-75c48d557e90
16772025-01-28T23:06:34.560ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16782025-01-28T23:06:34.560ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68
16792025-01-28T23:06:34.581ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16802025-01-28T23:06:34.581ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19
16812025-01-28T23:06:34.601ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16822025-01-28T23:06:34.601ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_21294dfd-a58f-42c6-a41c-8b148c95a198
16832025-01-28T23:06:34.623ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16842025-01-28T23:06:34.623ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ff6949fe-2851-437a-b6e9-cb91f2325920
16852025-01-28T23:06:34.644ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16862025-01-28T23:06:34.644ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_46e85043-614f-4a55-8660-1ccd892d22b2
16872025-01-28T23:06:34.666ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16882025-01-28T23:06:34.666ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b6f4a7de-ae5d-4497-bee3-21826d504667
16892025-01-28T23:06:34.685ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16902025-01-28T23:06:34.685ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79dc877f-201a-4a6a-a185-dc64a57ed603
16912025-01-28T23:06:34.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195784 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47528 req_id = ed84c687-77a7-4c8d-833e-e2c8230dd5b2 response_code = 200 uri = /inventory
16922025-01-28T23:06:35.621ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:42102 remote_addr = [fd00:1122:3344:101::d]:49049 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
16932025-01-28T23:06:35.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65610 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = c1a0dcbd-059d-4797-8874-c07fc15fb478 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
16942025-01-28T23:06:37.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57541
16952025-01-28T23:06:37.935ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16962025-01-28T23:06:37.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16972025-01-28T23:06:37.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16982025-01-28T23:06:37.935ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16992025-01-28T23:06:37.936ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17002025-01-28T23:06:37.936ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17012025-01-28T23:06:37.936ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17022025-01-28T23:06:37.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57541 req_id = a43eead4-526c-4e3a-8a4b-7507726bf561 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17032025-01-28T23:06:37.936ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1080
17042025-01-28T23:06:37.940ZINFOSledAgent (RSS): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17052025-01-28T23:06:37.940ZINFOSledAgent (RSS): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17062025-01-28T23:06:38.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39539
17072025-01-28T23:06:38.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17082025-01-28T23:06:38.409ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17092025-01-28T23:06:38.410ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
17102025-01-28T23:06:38.410ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
17112025-01-28T23:06:38.423ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17122025-01-28T23:06:38.423ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68044c5c-97c7-414c-b44a-b8251f523a8f
17132025-01-28T23:06:38.447ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17142025-01-28T23:06:38.447ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_099773d5-5f69-4f65-8f86-75c48d557e90
17152025-01-28T23:06:38.470ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17162025-01-28T23:06:38.470ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68
17172025-01-28T23:06:38.492ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17182025-01-28T23:06:38.493ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19
17192025-01-28T23:06:38.516ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17202025-01-28T23:06:38.516ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_21294dfd-a58f-42c6-a41c-8b148c95a198
17212025-01-28T23:06:38.540ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17222025-01-28T23:06:38.540ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ff6949fe-2851-437a-b6e9-cb91f2325920
17232025-01-28T23:06:38.563ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17242025-01-28T23:06:38.563ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_46e85043-614f-4a55-8660-1ccd892d22b2
17252025-01-28T23:06:38.585ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17262025-01-28T23:06:38.585ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b6f4a7de-ae5d-4497-bee3-21826d504667
17272025-01-28T23:06:38.605ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17282025-01-28T23:06:38.605ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79dc877f-201a-4a6a-a185-dc64a57ed603
17292025-01-28T23:06:38.617ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39539 req_id = 79d92291-e3f1-485f-a700-3b354706769f response_code = 200 uri = /inventory
17302025-01-28T23:06:39.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54248
17312025-01-28T23:06:39.110ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17322025-01-28T23:06:39.110ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17332025-01-28T23:06:39.110ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17342025-01-28T23:06:39.110ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17352025-01-28T23:06:39.110ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17362025-01-28T23:06:39.110ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17372025-01-28T23:06:39.110ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17382025-01-28T23:06:39.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54248 req_id = 59c6c54c-5082-4443-aad6-e1eec533a31b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17392025-01-28T23:06:39.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56792
17402025-01-28T23:06:39.219ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17412025-01-28T23:06:39.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17422025-01-28T23:06:39.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17432025-01-28T23:06:39.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17442025-01-28T23:06:39.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17452025-01-28T23:06:39.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17462025-01-28T23:06:39.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17472025-01-28T23:06:39.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56792 req_id = 30bf78a4-7844-4892-8f8c-62618592c41b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17482025-01-28T23:06:39.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47828
17492025-01-28T23:06:39.487ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17502025-01-28T23:06:39.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17512025-01-28T23:06:39.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17522025-01-28T23:06:39.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17532025-01-28T23:06:39.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17542025-01-28T23:06:39.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17552025-01-28T23:06:39.487ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17562025-01-28T23:06:39.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47828 req_id = 33203bce-468c-4c9f-8f5d-5757906f2fb1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17572025-01-28T23:06:45.616ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37843
17582025-01-28T23:06:45.616ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37843 req_id = 3c35e0ee-0343-45ea-851c-e5be61ea0065 response_code = 200 uri = /baseboard
17592025-01-28T23:06:49.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37794
17602025-01-28T23:06:49.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37794 req_id = b6a0221a-7156-4919-b0e9-3dfb85149fcf response_code = 200 uri = /vpc-routes
17612025-01-28T23:06:49.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
17622025-01-28T23:06:49.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 801 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37794 req_id = 2f668b98-7c98-46f5-9996-db5693c63e35 response_code = 204 uri = /eip-gateways
17632025-01-28T23:06:49.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1666 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37794 req_id = 9749b296-1158-4108-96bc-c7fa42801fd5 response_code = 204 uri = /vpc-routes
17642025-01-28T23:06:53.450ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65248
17652025-01-28T23:06:53.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65248 req_id = 5999b8b9-cf16-4322-b999-7ec9a56ca514 response_code = 200 uri = /vpc-routes
17662025-01-28T23:06:53.486ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
17672025-01-28T23:06:53.486ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65248 req_id = 572a82eb-59d9-44c7-b4f5-39741026d03a response_code = 204 uri = /eip-gateways
17682025-01-28T23:06:53.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58377
17692025-01-28T23:06:53.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 304 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58377 req_id = d360684e-c2af-4ea7-8539-1ad8e679a1ef response_code = 200 uri = /v2p
17702025-01-28T23:06:53.501ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:65248 req_id = d68bbafa-11fb-48a3-8c15-995c208915ae response_code = 204 uri = /vpc-routes
17712025-01-28T23:06:53.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36352
17722025-01-28T23:06:53.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36352 req_id = 7c5d25e8-17c5-4cae-8719-57f556e9a26e response_code = 200 uri = /vpc-routes
17732025-01-28T23:06:53.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36593
17742025-01-28T23:06:53.862ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17752025-01-28T23:06:53.960ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17762025-01-28T23:06:54.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170638 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:36593 req_id = bc84029f-5819-40d4-80e8-d0aeaba1c699 response_code = 204 uri = /switch-ports
17772025-01-28T23:06:54.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63451
17782025-01-28T23:06:54.033ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
17792025-01-28T23:06:54.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60224
17802025-01-28T23:06:54.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36352 req_id = 749a1cb8-58b0-4b8f-be10-e1f73013bda0 response_code = 204 uri = /eip-gateways
17812025-01-28T23:06:54.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58446
17822025-01-28T23:06:54.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60224 req_id = 8461688a-7b9f-46a9-a211-56a7ca20dc0e response_code = 200 uri = /vpc-routes
17832025-01-28T23:06:54.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 178 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58446 req_id = 5091604a-a547-4d9d-95e5-1878b4acd9b2 response_code = 200 uri = /v2p
17842025-01-28T23:06:54.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63451 req_id = 079897b5-b85b-4c2d-9a8a-70bad5b03db9 response_code = 200 uri = /v2p
17852025-01-28T23:06:54.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 404 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36593 req_id = 1f1b933b-9c47-4c1a-9b14-4a82fd89a695 response_code = 200 uri = /network-bootstore-config
17862025-01-28T23:06:54.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36352 req_id = 9c6331e0-c01c-45e0-bfbd-51a2c43389b1 response_code = 204 uri = /vpc-routes
17872025-01-28T23:06:54.092ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
17882025-01-28T23:06:54.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60224 req_id = 30e0168d-617d-4cf1-9be7-066830595d3d response_code = 204 uri = /eip-gateways
17892025-01-28T23:06:54.094ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
17902025-01-28T23:06:54.094ZINFOSledAgent (bootstore): Writing ledger to /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17912025-01-28T23:06:54.095ZINFOSledAgent (bootstore): Writing ledger to /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
17922025-01-28T23:06:54.096ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
17932025-01-28T23:06:54.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36593 req_id = 4058ac62-84f0-4bc0-9ffd-fe534d94446e response_code = 204 uri = /network-bootstore-config
17942025-01-28T23:06:54.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60224 req_id = c2ab809a-ef5f-4798-93d2-3b9c20c1a757 response_code = 204 uri = /vpc-routes
17952025-01-28T23:06:54.112ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38965
17962025-01-28T23:06:54.112ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17972025-01-28T23:06:54.152ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17982025-01-28T23:06:54.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38965 req_id = 83dfc039-b8fc-4dd2-8367-e8798e67c481 response_code = 204 uri = /switch-ports
17992025-01-28T23:06:54.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38965 req_id = f236dbf2-3dd6-4374-b4d4-28a6d2158f33 response_code = 200 uri = /network-bootstore-config
18002025-01-28T23:06:54.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33093
18012025-01-28T23:06:54.268ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18022025-01-28T23:06:54.304ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18032025-01-28T23:06:54.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89854 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33093 req_id = 7762be56-2674-4fba-9cbd-4642d552d46a response_code = 204 uri = /switch-ports
18042025-01-28T23:06:54.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33093 req_id = 3cc4d6ee-406d-4dbd-bb89-fa41aec1f1a8 response_code = 200 uri = /network-bootstore-config
18052025-01-28T23:07:05.628ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6300 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = fc46a575-8922-4b9b-805f-957e2208e252 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
18062025-01-28T23:07:15.651ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50307
18072025-01-28T23:07:15.651ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50307 req_id = 45f9ab03-8379-4a44-8830-80f62e1bf3af response_code = 200 uri = /baseboard
18082025-01-28T23:07:23.375ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63221
18092025-01-28T23:07:23.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63221 req_id = 1526cae6-bcd8-49be-ab1e-4db08f82e51e response_code = 200 uri = /vpc-routes
18102025-01-28T23:07:23.397ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
18112025-01-28T23:07:23.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63221 req_id = bb2b1745-29c4-4302-a95a-3daf6b3e8cf3 response_code = 204 uri = /eip-gateways
18122025-01-28T23:07:23.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63221 req_id = 43d3cdca-64fe-4bc3-bef0-413c474098bc response_code = 204 uri = /vpc-routes
18132025-01-28T23:07:23.486ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35339
18142025-01-28T23:07:23.486ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18152025-01-28T23:07:23.526ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18162025-01-28T23:07:23.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98968 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35339 req_id = afc34cf3-b368-4fee-b293-2951bc5fbd29 response_code = 204 uri = /switch-ports
18172025-01-28T23:07:23.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53475
18182025-01-28T23:07:23.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53475 req_id = 9b388938-08e5-46a5-911e-d9a0f46489ae response_code = 200 uri = /v2p
18192025-01-28T23:07:23.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35339 req_id = bf127aa0-3097-4fd6-bab4-936403c2f192 response_code = 200 uri = /network-bootstore-config
18202025-01-28T23:07:23.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36589
18212025-01-28T23:07:23.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36589 req_id = 334026a5-b847-4a83-852c-e45ea3ded128 response_code = 200 uri = /vpc-routes
18222025-01-28T23:07:23.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59533
18232025-01-28T23:07:23.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59533 req_id = c3aa9982-7a27-4a22-9a18-1bbe057ae6df response_code = 200 uri = /v2p
18242025-01-28T23:07:23.703ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
18252025-01-28T23:07:23.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36589 req_id = cf4e2b1c-4101-4dd9-b95d-83d5569896ca response_code = 204 uri = /eip-gateways
18262025-01-28T23:07:23.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36589 req_id = b57e09fd-6787-4c05-9a92-0ec1a53d770d response_code = 204 uri = /vpc-routes
18272025-01-28T23:07:23.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36338
18282025-01-28T23:07:23.746ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18292025-01-28T23:07:23.785ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18302025-01-28T23:07:23.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97682 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:36338 req_id = 11706b92-ff00-4ec6-aff0-71650eec4007 response_code = 204 uri = /switch-ports
18312025-01-28T23:07:23.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34364
18322025-01-28T23:07:23.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34364 req_id = b887b629-fbec-4f87-9843-eec28c25b417 response_code = 200 uri = /vpc-routes
18332025-01-28T23:07:23.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36338 req_id = 8c75859a-7f4b-4a38-bcf2-54b5ab32920a response_code = 200 uri = /network-bootstore-config
18342025-01-28T23:07:23.858ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
18352025-01-28T23:07:23.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34364 req_id = 78606bce-2e03-42cc-8359-3ac4d721153f response_code = 204 uri = /eip-gateways
18362025-01-28T23:07:23.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34364 req_id = 3a71389e-d20a-4409-b93a-0faa6d8519a2 response_code = 204 uri = /vpc-routes
18372025-01-28T23:07:24.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59062
18382025-01-28T23:07:24.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59062 req_id = a9b474cb-dd8e-4c0a-8b56-ac6f48f2cecc response_code = 200 uri = /v2p
18392025-01-28T23:07:24.186ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43569
18402025-01-28T23:07:24.186ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18412025-01-28T23:07:24.225ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18422025-01-28T23:07:24.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97365 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43569 req_id = dc1d5e22-709f-4230-82d0-958ad02412b5 response_code = 204 uri = /switch-ports
18432025-01-28T23:07:24.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43569 req_id = 82e22cf1-ea2e-4280-9579-0ddc11db746a response_code = 200 uri = /network-bootstore-config
18442025-01-28T23:07:35.628ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5422 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 0b5bb1ca-911c-4066-9a41-65cf8ffa7a1e response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
18452025-01-28T23:07:45.684ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56930
18462025-01-28T23:07:45.684ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:56930 req_id = 2893455e-6a55-46e9-862c-02ba530e2d4c response_code = 200 uri = /baseboard
18472025-01-28T23:07:53.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35208
18482025-01-28T23:07:53.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35208 req_id = 594a3b4b-f563-4aa6-ab88-4b144d5c5a9e response_code = 200 uri = /vpc-routes
18492025-01-28T23:07:53.450ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
18502025-01-28T23:07:53.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35208 req_id = 49fe7e64-5047-45fd-8bbf-1675e9b7275a response_code = 204 uri = /eip-gateways
18512025-01-28T23:07:53.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35208 req_id = 3c447968-e587-47a4-b5ab-51e8653509ad response_code = 204 uri = /vpc-routes
18522025-01-28T23:07:53.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49629
18532025-01-28T23:07:53.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49629 req_id = 1f6e52d1-02f0-43a7-90c1-85cabf7204c2 response_code = 200 uri = /vpc-routes
18542025-01-28T23:07:53.695ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
18552025-01-28T23:07:53.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49629 req_id = f05af5de-bd71-47e9-b1db-e06f9ef6ec3a response_code = 204 uri = /eip-gateways
18562025-01-28T23:07:53.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49629 req_id = f1751742-74dd-44b6-9b5e-37ade7632d0a response_code = 204 uri = /vpc-routes
18572025-01-28T23:07:53.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39886
18582025-01-28T23:07:53.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39886 req_id = 004332a8-d1a8-44c0-8648-147b4b3bfaeb response_code = 200 uri = /v2p
18592025-01-28T23:07:53.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43912
18602025-01-28T23:07:53.774ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18612025-01-28T23:07:53.816ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18622025-01-28T23:07:53.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123171 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43912 req_id = 4e79df73-7365-4c5d-9de7-233d3d3ac6df response_code = 204 uri = /switch-ports
18632025-01-28T23:07:53.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36357
18642025-01-28T23:07:53.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50812
18652025-01-28T23:07:53.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43912 req_id = 314bc107-b851-4891-8e91-3eb21deccb97 response_code = 200 uri = /network-bootstore-config
18662025-01-28T23:07:53.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38212
18672025-01-28T23:07:53.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36357 req_id = 5c2385de-f8b7-48fe-96ef-e2901b98f106 response_code = 200 uri = /vpc-routes
18682025-01-28T23:07:53.898ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18692025-01-28T23:07:53.903ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4939 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50812 req_id = 48147c1b-8bdc-475d-b05c-ad458b387de8 response_code = 200 uri = /v2p
18702025-01-28T23:07:53.941ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18712025-01-28T23:07:53.957ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
18722025-01-28T23:07:53.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 475 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36357 req_id = 1516c72f-daba-4b7a-8c68-b77876d96701 response_code = 204 uri = /eip-gateways
18732025-01-28T23:07:53.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36357 req_id = 8988766f-9c3b-4b55-9e26-15b2baec1457 response_code = 204 uri = /vpc-routes
18742025-01-28T23:07:53.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38212 req_id = bb8725d2-19a3-4763-b00a-e0f8264da20e response_code = 204 uri = /switch-ports
18752025-01-28T23:07:53.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38212 req_id = 649d5c23-8ae6-4afe-97d3-46d3d778b3a9 response_code = 200 uri = /network-bootstore-config
18762025-01-28T23:07:54.107ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54352
18772025-01-28T23:07:54.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54352 req_id = bed074f3-bea2-454b-b6e4-03c0bbf0cd24 response_code = 200 uri = /v2p
18782025-01-28T23:07:54.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64710
18792025-01-28T23:07:54.201ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18802025-01-28T23:07:54.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18812025-01-28T23:07:54.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86359 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64710 req_id = 783b0e6f-8a7b-4599-a58e-6c2013c436dd response_code = 204 uri = /switch-ports
18822025-01-28T23:07:54.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64710 req_id = 335b6bde-6364-496b-bff0-19236adf73c0 response_code = 200 uri = /network-bootstore-config
18832025-01-28T23:08:05.628ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5986 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = c904c6eb-9061-4b7d-9723-4249f115e71f response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
18842025-01-28T23:08:15.718ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43302
18852025-01-28T23:08:15.718ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43302 req_id = 207e2361-d8d3-4c17-81dc-368c5d1374ee response_code = 200 uri = /baseboard
18862025-01-28T23:08:23.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32879
18872025-01-28T23:08:23.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32879 req_id = f7103173-e3a8-4828-8358-1f4bf0d68d18 response_code = 200 uri = /vpc-routes
18882025-01-28T23:08:23.411ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
18892025-01-28T23:08:23.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32879 req_id = 495f25a0-be6d-4e77-8f0a-a29981c7428b response_code = 204 uri = /eip-gateways
18902025-01-28T23:08:23.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47492
18912025-01-28T23:08:23.428ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47492 req_id = b035d000-1b82-490b-9282-07abc6c2b8c2 response_code = 200 uri = /v2p
18922025-01-28T23:08:23.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32879 req_id = 08d33a1d-4e87-4e13-96da-502007aec918 response_code = 204 uri = /vpc-routes
18932025-01-28T23:08:23.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48598
18942025-01-28T23:08:23.495ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18952025-01-28T23:08:23.535ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18962025-01-28T23:08:23.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100664 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48598 req_id = 6e096ff7-fa3a-4d93-939f-72687200d525 response_code = 204 uri = /switch-ports
18972025-01-28T23:08:23.596ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41202
18982025-01-28T23:08:23.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41202 req_id = e7fe32f8-4868-48a0-a8ba-582782a54ca1 response_code = 200 uri = /vpc-routes
18992025-01-28T23:08:23.597ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48598 req_id = 9a63c3fb-3458-4fdb-abc8-1cfa79ada11f response_code = 200 uri = /network-bootstore-config
19002025-01-28T23:08:23.656ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
19012025-01-28T23:08:23.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41202 req_id = 8f22fc53-8891-4e1a-a4b8-a3bea772fc79 response_code = 204 uri = /eip-gateways
19022025-01-28T23:08:23.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41202 req_id = dad059c4-2622-438a-823f-917845cf8f06 response_code = 204 uri = /vpc-routes
19032025-01-28T23:08:23.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52168
19042025-01-28T23:08:23.744ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19052025-01-28T23:08:23.787ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19062025-01-28T23:08:23.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101940 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52168 req_id = fa7e50f8-4f42-4526-a4be-565ebe426892 response_code = 204 uri = /switch-ports
19072025-01-28T23:08:23.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42963
19082025-01-28T23:08:23.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42963 req_id = 5c0fb2a2-75a3-4d53-86b1-d4a838057178 response_code = 200 uri = /vpc-routes
19092025-01-28T23:08:23.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52168 req_id = 110e671b-a0ba-4ba7-8c80-33a7fe0bdc76 response_code = 200 uri = /network-bootstore-config
19102025-01-28T23:08:23.887ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
19112025-01-28T23:08:23.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42963 req_id = da768cff-9504-4e0e-83de-210940f81ed9 response_code = 204 uri = /eip-gateways
19122025-01-28T23:08:23.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56948
19132025-01-28T23:08:23.897ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56948 req_id = 6f63afd5-e32a-4f68-91ec-1fa7b0818cf4 response_code = 200 uri = /v2p
19142025-01-28T23:08:23.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42963 req_id = 1f997bfc-cebd-4d9d-ad38-5dd197d7ee43 response_code = 204 uri = /vpc-routes
19152025-01-28T23:08:23.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45068
19162025-01-28T23:08:23.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45068 req_id = 2e0ea27a-da5d-4dd6-8219-3e4597f66d98 response_code = 200 uri = /v2p
19172025-01-28T23:08:23.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55214
19182025-01-28T23:08:23.947ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19192025-01-28T23:08:23.983ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19202025-01-28T23:08:24.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91686 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55214 req_id = e7e9b7ff-cd33-401c-9752-a2c7c0c20da0 response_code = 204 uri = /switch-ports
19212025-01-28T23:08:24.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55214 req_id = 798379e4-6777-4419-b08c-7f81c14cf83e response_code = 200 uri = /network-bootstore-config
19222025-01-28T23:08:35.629ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6650 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 782fcd1c-d27a-479a-a033-cfd49ff49e23 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
19232025-01-28T23:08:45.752ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42272
19242025-01-28T23:08:45.753ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:42272 req_id = 7d412503-fb25-439f-8b8b-f21852bc1067 response_code = 200 uri = /baseboard
19252025-01-28T23:08:53.425ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44386
19262025-01-28T23:08:53.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44386 req_id = 78ac83bb-0e9e-443e-a43f-7d7b77f9c45d response_code = 200 uri = /vpc-routes
19272025-01-28T23:08:53.518ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
19282025-01-28T23:08:53.518ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44386 req_id = 4be6592b-edfb-46e7-ab3b-803b00b4fd0f response_code = 204 uri = /eip-gateways
19292025-01-28T23:08:53.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44386 req_id = 89ebf998-42bb-45bd-bfcf-20b99811b4ae response_code = 204 uri = /vpc-routes
19302025-01-28T23:08:53.690ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57512
19312025-01-28T23:08:53.690ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57512 req_id = 7b9bb659-183a-43d7-a9d1-ed708878aab0 response_code = 200 uri = /v2p
19322025-01-28T23:08:53.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60665
19332025-01-28T23:08:53.831ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19342025-01-28T23:08:53.872ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19352025-01-28T23:08:53.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103428 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60665 req_id = 08f255b0-c20c-436f-93fd-459f2a7eaf14 response_code = 204 uri = /switch-ports
19362025-01-28T23:08:53.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61550
19372025-01-28T23:08:53.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61550 req_id = 15363657-c946-4f1e-9ca9-7e56445ceca8 response_code = 200 uri = /vpc-routes
19382025-01-28T23:08:53.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60665 req_id = 62f75031-8944-4ffe-80f2-d39912d06d84 response_code = 200 uri = /network-bootstore-config
19392025-01-28T23:08:53.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52105
19402025-01-28T23:08:53.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52105 req_id = fbd60eac-31f4-4a37-b181-96b6df2e48ed response_code = 200 uri = /vpc-routes
19412025-01-28T23:08:53.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
19422025-01-28T23:08:53.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61550 req_id = f9ab68a3-7199-42df-a96c-23e1530deacd response_code = 204 uri = /eip-gateways
19432025-01-28T23:08:53.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47486
19442025-01-28T23:08:53.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47486 req_id = d7ae5400-78f8-49b2-84d6-bfc3dbad8dff response_code = 200 uri = /v2p
19452025-01-28T23:08:53.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61550 req_id = 8e39ff11-3eea-4193-8561-333ad917975d response_code = 204 uri = /vpc-routes
19462025-01-28T23:08:54.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
19472025-01-28T23:08:54.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52105 req_id = e47592b5-2ba2-4b64-9e6a-d4181201e3fb response_code = 204 uri = /eip-gateways
19482025-01-28T23:08:54.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52105 req_id = 83ec0271-94f5-440e-af1a-5ca70e93d637 response_code = 204 uri = /vpc-routes
19492025-01-28T23:08:54.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57470
19502025-01-28T23:08:54.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19512025-01-28T23:08:54.198ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19522025-01-28T23:08:54.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92463 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57470 req_id = c696aff9-8669-440e-b64a-2881581aee7b response_code = 204 uri = /switch-ports
19532025-01-28T23:08:54.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52501
19542025-01-28T23:08:54.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56153
19552025-01-28T23:08:54.251ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19562025-01-28T23:08:54.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57470 req_id = e7ca0f57-d8a4-4634-91c2-b4b9685a609a response_code = 200 uri = /network-bootstore-config
19572025-01-28T23:08:54.254ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52501 req_id = 57ae6acf-a21f-4166-8d4f-cf128be270c5 response_code = 200 uri = /v2p
19582025-01-28T23:08:54.286ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19592025-01-28T23:08:54.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93566 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56153 req_id = 8130694c-fd71-4d13-a326-77252f142ac2 response_code = 204 uri = /switch-ports
19602025-01-28T23:08:54.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56153 req_id = aab98512-53b8-4a24-b226-a50e33b53b97 response_code = 200 uri = /network-bootstore-config
19612025-01-28T23:09:04.021ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19622025-01-28T23:09:05.629ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6323 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = f29e46aa-9f52-4192-8b10-9128158f115e response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
19632025-01-28T23:09:15.786ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36051
19642025-01-28T23:09:15.786ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36051 req_id = cd59e7b0-49cf-4cfc-b182-0183af4ee6f4 response_code = 200 uri = /baseboard
19652025-01-28T23:09:23.314ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38951
19662025-01-28T23:09:23.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38951 req_id = 073b6599-d5f7-434a-a014-2f5f01ba18af response_code = 200 uri = /vpc-routes
19672025-01-28T23:09:23.356ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
19682025-01-28T23:09:23.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38951 req_id = 9986dcfa-868a-409b-a90e-97ef335b04b9 response_code = 204 uri = /eip-gateways
19692025-01-28T23:09:23.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60674
19702025-01-28T23:09:23.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60674 req_id = fa76f528-4a7f-46be-a418-29f117933d47 response_code = 200 uri = /v2p
19712025-01-28T23:09:23.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38951 req_id = 0f2b04f8-fbd7-4191-8743-5505c6e3237c response_code = 204 uri = /vpc-routes
19722025-01-28T23:09:23.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49374
19732025-01-28T23:09:23.446ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19742025-01-28T23:09:23.489ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19752025-01-28T23:09:23.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102569 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49374 req_id = 191731a8-7e16-4557-a1ee-9368a96c07bc response_code = 204 uri = /switch-ports
19762025-01-28T23:09:23.549ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49374 req_id = 75e33949-8c89-4295-818f-d327186f2008 response_code = 200 uri = /network-bootstore-config
19772025-01-28T23:09:23.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50312
19782025-01-28T23:09:23.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50312 req_id = e4e17897-d643-4d63-b9fa-f5ed6658830d response_code = 200 uri = /vpc-routes
19792025-01-28T23:09:23.589ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
19802025-01-28T23:09:23.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50312 req_id = 4c7f8689-4c26-44d3-af93-ae670d357f06 response_code = 204 uri = /eip-gateways
19812025-01-28T23:09:23.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50312 req_id = 3b2ce475-29c4-49d3-9855-5a265f185293 response_code = 204 uri = /vpc-routes
19822025-01-28T23:09:23.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42249
19832025-01-28T23:09:23.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42249 req_id = d29e8233-4590-4008-aabb-e522ba1d0ea5 response_code = 200 uri = /v2p
19842025-01-28T23:09:23.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63071
19852025-01-28T23:09:23.745ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19862025-01-28T23:09:23.786ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19872025-01-28T23:09:23.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100010 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63071 req_id = b9ff7bb9-24c7-41c5-9dc8-dc01cd6a02fb response_code = 204 uri = /switch-ports
19882025-01-28T23:09:23.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63071 req_id = e049d7b7-a643-43a2-a901-3139ba489b25 response_code = 200 uri = /network-bootstore-config
19892025-01-28T23:09:23.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62108
19902025-01-28T23:09:23.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62108 req_id = bf4e740f-b1b2-4ab3-a405-2e06c55bc682 response_code = 200 uri = /vpc-routes
19912025-01-28T23:09:23.976ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
19922025-01-28T23:09:23.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62108 req_id = a996f9cc-fc16-41ff-bc51-783bf16ad608 response_code = 204 uri = /eip-gateways
19932025-01-28T23:09:24.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53071
19942025-01-28T23:09:24.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53071 req_id = 55053ec8-ab16-4b8d-a5da-db28d2e51670 response_code = 200 uri = /v2p
19952025-01-28T23:09:24.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62108 req_id = c798857e-55fc-4f83-9e2e-4690d6955ac8 response_code = 204 uri = /vpc-routes
19962025-01-28T23:09:24.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57846
19972025-01-28T23:09:24.029ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19982025-01-28T23:09:24.065ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19992025-01-28T23:09:24.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90126 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57846 req_id = 13c1499b-5083-4ce0-9f9d-84649369dcbb response_code = 204 uri = /switch-ports
20002025-01-28T23:09:24.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57846 req_id = 9dac20ef-e349-4c58-8424-c5ffbbd34643 response_code = 200 uri = /network-bootstore-config
20012025-01-28T23:09:35.629ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6123 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 382f48b3-f6e8-4be5-991b-3a44313208ab response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
20022025-01-28T23:09:45.819ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50627
20032025-01-28T23:09:45.819ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:50627 req_id = 79ddcb25-aacc-42fc-8c16-f206ae1bd3ba response_code = 200 uri = /baseboard
20042025-01-28T23:09:53.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48717
20052025-01-28T23:09:53.511ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48717 req_id = ccc76183-f431-47b9-8fd0-bc36723fef61 response_code = 200 uri = /v2p
20062025-01-28T23:09:53.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61230
20072025-01-28T23:09:53.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61230 req_id = 9512352b-ecea-4e05-9f38-a4f177d54601 response_code = 200 uri = /vpc-routes
20082025-01-28T23:09:53.547ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
20092025-01-28T23:09:53.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61230 req_id = 5c0c9c80-a101-4ba5-acd1-8eabf3ab90f0 response_code = 204 uri = /eip-gateways
20102025-01-28T23:09:53.557ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61230 req_id = 43aa0c97-d2a3-423d-b864-fae934190568 response_code = 204 uri = /vpc-routes
20112025-01-28T23:09:53.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34717
20122025-01-28T23:09:53.642ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20132025-01-28T23:09:53.694ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20142025-01-28T23:09:53.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34717 req_id = 22638454-8c3f-498a-92c3-ee7b08728f9e response_code = 204 uri = /switch-ports
20152025-01-28T23:09:53.765ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44468
20162025-01-28T23:09:53.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44468 req_id = 17448555-893a-405a-a79b-70a7423dfc67 response_code = 200 uri = /vpc-routes
20172025-01-28T23:09:53.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34717 req_id = d92a912d-3ebf-43d4-8629-5ae1e27fd152 response_code = 200 uri = /network-bootstore-config
20182025-01-28T23:09:53.772ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34188
20192025-01-28T23:09:53.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34188 req_id = e47f1607-5ffb-4f6d-b627-a544ba1ac428 response_code = 200 uri = /v2p
20202025-01-28T23:09:53.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
20212025-01-28T23:09:53.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44468 req_id = b1c15153-b65d-4060-885d-0ef409cd8d39 response_code = 204 uri = /eip-gateways
20222025-01-28T23:09:53.831ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44468 req_id = 84edb47a-19c0-47ae-9428-f5e4d88c1610 response_code = 204 uri = /vpc-routes
20232025-01-28T23:09:53.839ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43676
20242025-01-28T23:09:53.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43676 req_id = 6507fd71-dd10-4607-af8e-b374ddef2601 response_code = 200 uri = /v2p
20252025-01-28T23:09:53.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54910
20262025-01-28T23:09:53.942ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20272025-01-28T23:09:53.982ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20282025-01-28T23:09:54.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96801 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54910 req_id = 181ea912-81c1-4af4-8c9f-94184d67db2c response_code = 204 uri = /switch-ports
20292025-01-28T23:09:54.039ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57949
20302025-01-28T23:09:54.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57949 req_id = 03f1ac59-d4d5-4ef2-ad7f-99ca8b5ae3c8 response_code = 200 uri = /vpc-routes
20312025-01-28T23:09:54.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54910 req_id = 7af6d8b2-b5ae-4288-8e6a-1cfa4a135f84 response_code = 200 uri = /network-bootstore-config
20322025-01-28T23:09:54.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
20332025-01-28T23:09:54.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57949 req_id = ef72d912-e569-484d-8e56-c2f611d3bfa2 response_code = 204 uri = /eip-gateways
20342025-01-28T23:09:54.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57949 req_id = dfddbe9c-30e6-4638-9acb-207e40ecd4a0 response_code = 204 uri = /vpc-routes
20352025-01-28T23:09:54.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54210
20362025-01-28T23:09:54.211ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20372025-01-28T23:09:54.248ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20382025-01-28T23:09:54.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88703 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54210 req_id = cf57125a-984b-4039-9f60-8885bd15aaff response_code = 204 uri = /switch-ports
20392025-01-28T23:09:54.301ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54210 req_id = 9f041c65-fe98-428c-bd58-b96bbf2f971b response_code = 200 uri = /network-bootstore-config
20402025-01-28T23:10:05.631ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6912 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = d289534b-97cf-417c-9116-3eff89a1af6c response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
20412025-01-28T23:10:15.854ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63818
20422025-01-28T23:10:15.854ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63818 req_id = 095807b2-6767-48b2-964d-32f9fa004ff3 response_code = 200 uri = /baseboard
20432025-01-28T23:10:23.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56702
20442025-01-28T23:10:23.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56702 req_id = c1f3635f-fa9a-4629-a4ed-21dbd3f35a0d response_code = 200 uri = /vpc-routes
20452025-01-28T23:10:23.314ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
20462025-01-28T23:10:23.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56702 req_id = 14ce3777-15a8-44e1-9049-a03330733dcd response_code = 204 uri = /eip-gateways
20472025-01-28T23:10:23.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56702 req_id = 08923125-2d7b-4729-a63c-19d0e8994844 response_code = 204 uri = /vpc-routes
20482025-01-28T23:10:23.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59840
20492025-01-28T23:10:23.383ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20502025-01-28T23:10:23.432ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20512025-01-28T23:10:23.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119433 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59840 req_id = 7fc0fe28-80e6-413a-b24d-48430b7afb8e response_code = 204 uri = /switch-ports
20522025-01-28T23:10:23.503ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44252
20532025-01-28T23:10:23.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59840 req_id = 0e285964-c6d4-4d64-92f3-8e9d76d687fb response_code = 200 uri = /network-bootstore-config
20542025-01-28T23:10:23.504ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44252 req_id = 7245c9f8-e8da-422c-be90-d6f6d8178fd7 response_code = 200 uri = /v2p
20552025-01-28T23:10:23.546ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33386
20562025-01-28T23:10:23.547ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33386 req_id = 3381dad2-7a22-4363-a4a9-2b83cb501b25 response_code = 200 uri = /vpc-routes
20572025-01-28T23:10:23.561ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
20582025-01-28T23:10:23.561ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33386 req_id = 8d832049-2300-4070-9d2c-e8f78bf08553 response_code = 204 uri = /eip-gateways
20592025-01-28T23:10:23.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33386 req_id = 6143a5da-c817-493f-a36e-5412939695ed response_code = 204 uri = /vpc-routes
20602025-01-28T23:10:23.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46020
20612025-01-28T23:10:23.638ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20622025-01-28T23:10:23.681ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20632025-01-28T23:10:23.741ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46020 req_id = b3a0c679-d1ad-4146-b090-82af94003bdc response_code = 204 uri = /switch-ports
20642025-01-28T23:10:23.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34551
20652025-01-28T23:10:23.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34551 req_id = 77a28d55-85a4-4b7f-9123-3b197b6f8020 response_code = 200 uri = /v2p
20662025-01-28T23:10:23.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46020 req_id = c130f88d-86e7-404d-976f-47616edefd7b response_code = 200 uri = /network-bootstore-config
20672025-01-28T23:10:23.753ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38325
20682025-01-28T23:10:23.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38325 req_id = 7e9c92b4-609d-464d-9a2f-243f9df00127 response_code = 200 uri = /v2p
20692025-01-28T23:10:23.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53444
20702025-01-28T23:10:23.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53444 req_id = 4f26eaf9-4015-404a-84b8-114057c334e2 response_code = 200 uri = /vpc-routes
20712025-01-28T23:10:23.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
20722025-01-28T23:10:23.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53444 req_id = 02b495bd-67c0-4153-9fbd-da80e8cb6cc6 response_code = 204 uri = /eip-gateways
20732025-01-28T23:10:23.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53444 req_id = cc87e22b-453a-41ea-8bd0-cbed1dd056e0 response_code = 204 uri = /vpc-routes
20742025-01-28T23:10:23.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48145
20752025-01-28T23:10:23.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20762025-01-28T23:10:23.993ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20772025-01-28T23:10:24.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48145 req_id = d32776fe-4fe5-4b89-8fcf-d1c2b3b06a86 response_code = 204 uri = /switch-ports
20782025-01-28T23:10:24.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48145 req_id = b6d32cf9-5401-44b7-8eaf-c98b84294d50 response_code = 200 uri = /network-bootstore-config
20792025-01-28T23:10:35.631ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6014 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 3f9f9f8a-e5e3-4243-9f0c-883a6343fab9 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
20802025-01-28T23:10:45.888ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48607
20812025-01-28T23:10:45.888ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48607 req_id = 4aeb7b83-6b62-4d7f-a6c8-6247ba7df741 response_code = 200 uri = /baseboard
20822025-01-28T23:10:53.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56542
20832025-01-28T23:10:53.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56542 req_id = f71d1b32-7c05-4c7a-8b9b-749e790205e6 response_code = 200 uri = /vpc-routes
20842025-01-28T23:10:53.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64192
20852025-01-28T23:10:53.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64192 req_id = 1326bfb2-99dd-465c-9492-98ba0f2006c4 response_code = 200 uri = /v2p
20862025-01-28T23:10:53.503ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
20872025-01-28T23:10:53.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56542 req_id = acc48552-bfa3-47a6-84d3-100214c905e9 response_code = 204 uri = /eip-gateways
20882025-01-28T23:10:53.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56542 req_id = 563f4729-d093-47f2-aa22-d8104f5e7f5f response_code = 204 uri = /vpc-routes
20892025-01-28T23:10:53.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55543
20902025-01-28T23:10:53.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55543 req_id = 8c47490f-a03f-485d-9646-ea42e471efa1 response_code = 200 uri = /vpc-routes
20912025-01-28T23:10:53.616ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65267
20922025-01-28T23:10:53.616ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20932025-01-28T23:10:53.681ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20942025-01-28T23:10:53.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164373 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65267 req_id = be8f5eae-62b7-4aca-9906-0cf2913d8bcb response_code = 204 uri = /switch-ports
20952025-01-28T23:10:53.781ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
20962025-01-28T23:10:53.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55543 req_id = 4c7033e4-ccaf-4a2d-8d9b-a0d8a95f6276 response_code = 204 uri = /eip-gateways
20972025-01-28T23:10:53.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5628 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65267 req_id = 1a3a34da-0cf7-4d7b-ae93-0d228acb36de response_code = 200 uri = /network-bootstore-config
20982025-01-28T23:10:53.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52249
20992025-01-28T23:10:53.787ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32853
21002025-01-28T23:10:53.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 466 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32853 req_id = ab67d329-cb07-450b-8df2-da3830aabfe4 response_code = 200 uri = /v2p
21012025-01-28T23:10:53.788ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21022025-01-28T23:10:53.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21032025-01-28T23:10:53.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21042025-01-28T23:10:53.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21052025-01-28T23:10:53.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21062025-01-28T23:10:53.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21072025-01-28T23:10:53.788ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21082025-01-28T23:10:53.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 853 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52249 req_id = a0681e82-7c5f-4ad0-be02-4b1c5ce6c0bd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21092025-01-28T23:10:53.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55543 req_id = 83fb15f2-e676-4c10-bbac-d6702790bd9f response_code = 204 uri = /vpc-routes
21102025-01-28T23:10:53.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54762
21112025-01-28T23:10:53.876ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21122025-01-28T23:10:53.913ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21132025-01-28T23:10:53.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89479 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54762 req_id = 17884271-ef5e-4631-aa01-0fc1f8988470 response_code = 204 uri = /switch-ports
21142025-01-28T23:10:53.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54762 req_id = feb67ede-6ce4-4e41-a8ea-267c8182f8d6 response_code = 200 uri = /network-bootstore-config
21152025-01-28T23:10:54.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36079
21162025-01-28T23:10:54.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36079 req_id = d429ea6f-bc33-42da-8b83-c1ad2ad4d993 response_code = 200 uri = /vpc-routes
21172025-01-28T23:10:54.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53762
21182025-01-28T23:10:54.150ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21192025-01-28T23:10:54.191ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21202025-01-28T23:10:54.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96879 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53762 req_id = b20fa55d-13d9-41c4-8fa6-e681b294f3ca response_code = 204 uri = /switch-ports
21212025-01-28T23:10:54.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58490
21222025-01-28T23:10:54.248ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
21232025-01-28T23:10:54.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36079 req_id = 92714a1e-f75b-4248-85c8-b6e2bc762694 response_code = 204 uri = /eip-gateways
21242025-01-28T23:10:54.248ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33541
21252025-01-28T23:10:54.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33541 req_id = 05957247-1930-4465-926d-1bd80f18e1c8 response_code = 200 uri = /v2p
21262025-01-28T23:10:54.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53762 req_id = 1e50186d-f981-447b-ace0-936491120093 response_code = 200 uri = /network-bootstore-config
21272025-01-28T23:10:54.248ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21282025-01-28T23:10:54.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21292025-01-28T23:10:54.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21302025-01-28T23:10:54.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21312025-01-28T23:10:54.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21322025-01-28T23:10:54.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21332025-01-28T23:10:54.248ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21342025-01-28T23:10:54.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 461 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58490 req_id = 22bcbdc9-1e48-4723-8294-3f33d9c0e30a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21352025-01-28T23:10:54.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36079 req_id = 13defdfd-23fd-4a66-8872-03de0e79bbe5 response_code = 204 uri = /vpc-routes
21362025-01-28T23:10:54.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47835
21372025-01-28T23:10:54.353ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21382025-01-28T23:10:54.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21392025-01-28T23:10:54.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21402025-01-28T23:10:54.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21412025-01-28T23:10:54.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21422025-01-28T23:10:54.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21432025-01-28T23:10:54.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21442025-01-28T23:10:54.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47835 req_id = 9becc972-1d5c-4fed-b905-4a3ae1416f19 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21452025-01-28T23:11:05.630ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6443 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = ea4eb118-2441-4a23-a971-03de3aaad737 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
21462025-01-28T23:11:15.920ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63807
21472025-01-28T23:11:15.920ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63807 req_id = 66735a94-0984-44f1-9740-e6e0f88a4db2 response_code = 200 uri = /baseboard
21482025-01-28T23:11:23.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55198
21492025-01-28T23:11:23.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55198 req_id = cd4a9ab5-6558-4597-8d5a-0612360878d0 response_code = 200 uri = /vpc-routes
21502025-01-28T23:11:23.316ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
21512025-01-28T23:11:23.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55198 req_id = 767b22af-e96d-4fe1-83a5-bffb986156b4 response_code = 204 uri = /eip-gateways
21522025-01-28T23:11:23.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36189
21532025-01-28T23:11:23.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36189 req_id = eb6fc11a-7962-4c1d-ad7a-61224d3b3f3a response_code = 200 uri = /v2p
21542025-01-28T23:11:23.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55198 req_id = 50f7925f-8a64-4c49-8ce8-e62b2eeb3eb6 response_code = 204 uri = /vpc-routes
21552025-01-28T23:11:23.405ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56418
21562025-01-28T23:11:23.405ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21572025-01-28T23:11:23.448ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21582025-01-28T23:11:23.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119583 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56418 req_id = d67c2e23-78a3-4d8f-83ec-71e22aefed93 response_code = 204 uri = /switch-ports
21592025-01-28T23:11:23.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56418 req_id = 617fc6e2-f6e8-4ae9-9b5c-32a8c7f165d1 response_code = 200 uri = /network-bootstore-config
21602025-01-28T23:11:23.585ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56091
21612025-01-28T23:11:23.585ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56091 req_id = 8a674ef2-5fb9-463c-a705-5d6f5a221d1e response_code = 200 uri = /vpc-routes
21622025-01-28T23:11:23.649ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
21632025-01-28T23:11:23.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56091 req_id = f5506eb9-cc18-469c-b5ae-e7f4035d659d response_code = 204 uri = /eip-gateways
21642025-01-28T23:11:23.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56091 req_id = b83e4c86-6067-4ad4-9303-61e18c80785a response_code = 204 uri = /vpc-routes
21652025-01-28T23:11:23.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58855
21662025-01-28T23:11:23.684ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21672025-01-28T23:11:23.720ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21682025-01-28T23:11:23.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95017 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58855 req_id = b58b640d-0a86-4713-9a6c-faa0c3a48a56 response_code = 204 uri = /switch-ports
21692025-01-28T23:11:23.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48199
21702025-01-28T23:11:23.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48199 req_id = 7ecb8f84-3257-4738-81f9-e6f77c38c22b response_code = 200 uri = /v2p
21712025-01-28T23:11:23.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39325
21722025-01-28T23:11:23.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58855 req_id = b046e5b2-6c5d-4d92-ab1c-3e9224a2fa93 response_code = 200 uri = /network-bootstore-config
21732025-01-28T23:11:23.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39325 req_id = 8c4d0fe0-889a-4bbc-89de-0a8ee82141e3 response_code = 200 uri = /vpc-routes
21742025-01-28T23:11:23.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
21752025-01-28T23:11:23.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39325 req_id = f2f8271f-7e6d-4db4-a1bf-d9b95745c271 response_code = 204 uri = /eip-gateways
21762025-01-28T23:11:23.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36960
21772025-01-28T23:11:23.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36960 req_id = 3f198d2d-7c9c-426e-801e-beebaa7dc2af response_code = 200 uri = /v2p
21782025-01-28T23:11:23.828ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39325 req_id = 097166c5-306c-4c2b-b664-8b9b677e8a7a response_code = 204 uri = /vpc-routes
21792025-01-28T23:11:23.876ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49941
21802025-01-28T23:11:23.876ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21812025-01-28T23:11:23.913ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21822025-01-28T23:11:23.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49941 req_id = 816a6d6b-f97e-4849-9202-04529ef38514 response_code = 204 uri = /switch-ports
21832025-01-28T23:11:23.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49941 req_id = 95d92fc9-9fa0-479a-9294-607ae339f80b response_code = 200 uri = /network-bootstore-config
21842025-01-28T23:11:35.632ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7429 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = f342f4ef-dfb3-4e4d-89a6-94485f4b8ef5 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
21852025-01-28T23:11:45.955ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54997
21862025-01-28T23:11:45.956ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54997 req_id = c7f8f60c-03b0-48cd-ae4d-e68f93c01fe3 response_code = 200 uri = /baseboard
21872025-01-28T23:11:53.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43185
21882025-01-28T23:11:53.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43185 req_id = f3b58d5b-f3f9-410c-aedc-ba9e1654b669 response_code = 200 uri = /v2p
21892025-01-28T23:11:53.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48359
21902025-01-28T23:11:53.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48359 req_id = b305560a-393b-4892-894c-3c17c3f04c10 response_code = 200 uri = /vpc-routes
21912025-01-28T23:11:53.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63121
21922025-01-28T23:11:53.730ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63121 req_id = 4e1181b3-7a54-455e-9845-de420e519f52 response_code = 200 uri = /vpc-routes
21932025-01-28T23:11:53.734ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
21942025-01-28T23:11:53.734ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48359 req_id = 9f251a13-2dae-4fab-9043-a0151c4ebc7e response_code = 204 uri = /eip-gateways
21952025-01-28T23:11:53.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61119
21962025-01-28T23:11:53.769ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21972025-01-28T23:11:53.809ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21982025-01-28T23:11:53.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101643 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61119 req_id = 552a3b40-bd94-4fe5-87b6-08345a536ca3 response_code = 204 uri = /switch-ports
21992025-01-28T23:11:53.871ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
22002025-01-28T23:11:53.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63121 req_id = 75efe204-5635-4fbd-bf82-4e2e21f34331 response_code = 204 uri = /eip-gateways
22012025-01-28T23:11:53.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59992
22022025-01-28T23:11:53.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38287
22032025-01-28T23:11:53.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45324
22042025-01-28T23:11:53.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 352 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61119 req_id = 7db85e75-594e-4cf1-a12d-8620a3e8e744 response_code = 200 uri = /network-bootstore-config
22052025-01-28T23:11:53.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 699 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48359 req_id = 6dc59394-9fd3-42d6-80e6-cb888afc39cd response_code = 204 uri = /vpc-routes
22062025-01-28T23:11:53.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45324 req_id = 21cb5f8b-0bf8-487d-87c4-82d9bf3bd746 response_code = 200 uri = /vpc-routes
22072025-01-28T23:11:53.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22082025-01-28T23:11:53.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6915 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59992 req_id = 0c8acb22-6487-4c0e-aa61-71206b8e3d5a response_code = 200 uri = /v2p
22092025-01-28T23:11:53.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63121 req_id = 7358d890-6faa-4a7a-8422-45ae7279abb0 response_code = 204 uri = /vpc-routes
22102025-01-28T23:11:53.927ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22112025-01-28T23:11:53.945ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
22122025-01-28T23:11:53.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45324 req_id = ece41d19-7e7c-4817-b3ca-4679a3f125c2 response_code = 204 uri = /eip-gateways
22132025-01-28T23:11:53.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 494 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45324 req_id = b7318786-3832-4db9-82c4-3c855b06cd03 response_code = 204 uri = /vpc-routes
22142025-01-28T23:11:54.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129471 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38287 req_id = 1e858c55-b1e1-4c25-a967-66642f5049ae response_code = 204 uri = /switch-ports
22152025-01-28T23:11:54.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38287 req_id = 5b7705fe-161f-4d44-9717-f43102225fa9 response_code = 200 uri = /network-bootstore-config
22162025-01-28T23:11:54.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34242
22172025-01-28T23:11:54.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34242 req_id = 1b6b955f-4b7e-411d-bca5-9fb2b38a2dae response_code = 200 uri = /v2p
22182025-01-28T23:11:54.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37626
22192025-01-28T23:11:54.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22202025-01-28T23:11:54.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22212025-01-28T23:11:54.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89512 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37626 req_id = 93c87960-be6b-40d9-b6a9-af0471a0bd6c response_code = 204 uri = /switch-ports
22222025-01-28T23:11:54.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37626 req_id = 69d1bef9-50ec-4f6f-8afe-b57fb264181d response_code = 200 uri = /network-bootstore-config
22232025-01-28T23:12:05.633ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8977 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 07ee2023-d06b-4dfc-9d4f-03eeda704733 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
22242025-01-28T23:12:15.989ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62752
22252025-01-28T23:12:15.989ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62752 req_id = 011b7117-b765-4b45-a968-cae782e2756c response_code = 200 uri = /baseboard
22262025-01-28T23:12:23.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52712
22272025-01-28T23:12:23.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52712 req_id = d44c1259-e933-418e-a930-b63d557d7a39 response_code = 200 uri = /vpc-routes
22282025-01-28T23:12:23.368ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
22292025-01-28T23:12:23.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52712 req_id = 29011d6d-a673-4869-986b-2db3c153b3ac response_code = 204 uri = /eip-gateways
22302025-01-28T23:12:23.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52712 req_id = 507201f4-9d28-4ea3-a026-604fa2e0c705 response_code = 204 uri = /vpc-routes
22312025-01-28T23:12:23.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35662
22322025-01-28T23:12:23.417ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22332025-01-28T23:12:23.455ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22342025-01-28T23:12:23.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99477 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35662 req_id = 905cac85-be84-46bf-a75d-98809967054c response_code = 204 uri = /switch-ports
22352025-01-28T23:12:23.516ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42459
22362025-01-28T23:12:23.517ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53345
22372025-01-28T23:12:23.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35662 req_id = 3278eaf3-86eb-4de3-ae60-d1f9fc40c586 response_code = 200 uri = /network-bootstore-config
22382025-01-28T23:12:23.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42459 req_id = fc8533b8-7747-4f64-af11-6756a7cc220c response_code = 200 uri = /v2p
22392025-01-28T23:12:23.517ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53345 req_id = 5670ed6e-eb3b-4581-b271-6da8218fc29f response_code = 200 uri = /vpc-routes
22402025-01-28T23:12:23.563ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
22412025-01-28T23:12:23.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53345 req_id = ec592708-255b-4200-8071-22f0d26c8aca response_code = 204 uri = /eip-gateways
22422025-01-28T23:12:23.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53345 req_id = 75077721-25e9-4018-ac5f-580bd1a4b6b5 response_code = 204 uri = /vpc-routes
22432025-01-28T23:12:23.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43303
22442025-01-28T23:12:23.638ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22452025-01-28T23:12:23.683ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22462025-01-28T23:12:23.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112861 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43303 req_id = 1b38f103-c85a-4a56-bc16-48e4998368d2 response_code = 204 uri = /switch-ports
22472025-01-28T23:12:23.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33189
22482025-01-28T23:12:23.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33189 req_id = ab4b50de-be45-4cb1-9c1d-ccf91e43095d response_code = 200 uri = /v2p
22492025-01-28T23:12:23.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43303 req_id = 6f6e7fcf-177d-4c9a-887b-bcf5700a9584 response_code = 200 uri = /network-bootstore-config
22502025-01-28T23:12:23.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52668
22512025-01-28T23:12:23.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52668 req_id = a98c4d85-e8cc-4eb7-ad68-f4991a8f8027 response_code = 200 uri = /vpc-routes
22522025-01-28T23:12:23.833ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
22532025-01-28T23:12:23.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52668 req_id = 2ecb38cf-68c1-488e-a687-1a07733f047f response_code = 204 uri = /eip-gateways
22542025-01-28T23:12:23.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:52668 req_id = 651b8d7c-b7c0-46a2-8e80-1ed49adf14cd response_code = 204 uri = /vpc-routes
22552025-01-28T23:12:23.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34744
22562025-01-28T23:12:23.859ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22572025-01-28T23:12:23.895ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22582025-01-28T23:12:23.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88178 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34744 req_id = 65df09c8-d6e5-49a0-8e80-6289c2472552 response_code = 204 uri = /switch-ports
22592025-01-28T23:12:23.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45562
22602025-01-28T23:12:23.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 358 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34744 req_id = 231434d7-8c82-49af-bed7-f6a15f3b4e42 response_code = 200 uri = /network-bootstore-config
22612025-01-28T23:12:23.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45562 req_id = 95cdaccd-f0b0-4124-bbda-f671223e7078 response_code = 200 uri = /v2p
22622025-01-28T23:12:35.633ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7962 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = ce1e09d7-2d57-4cae-971d-97ee603b8007 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
22632025-01-28T23:12:46.021ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53078
22642025-01-28T23:12:46.021ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53078 req_id = da6f6465-3b49-42cc-b445-b30104c1c3b1 response_code = 200 uri = /baseboard
22652025-01-28T23:12:53.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45706
22662025-01-28T23:12:53.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45706 req_id = 715dfa61-3940-4ca0-ac13-3c4c383f5584 response_code = 200 uri = /vpc-routes
22672025-01-28T23:12:53.448ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
22682025-01-28T23:12:53.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45706 req_id = 101138ce-13a9-480b-af1d-13ce21d6922d response_code = 204 uri = /eip-gateways
22692025-01-28T23:12:53.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 272 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45706 req_id = 2ce7d3ba-2495-4340-9a26-6180cebabb45 response_code = 204 uri = /vpc-routes
22702025-01-28T23:12:53.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62743
22712025-01-28T23:12:53.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62743 req_id = 3b1a2f0e-9df2-4179-bfdc-650c23682d8b response_code = 200 uri = /vpc-routes
22722025-01-28T23:12:53.691ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33846
22732025-01-28T23:12:53.692ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 259 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33846 req_id = 8dcbffdc-ee12-4874-98ea-3cfb6472ff31 response_code = 200 uri = /v2p
22742025-01-28T23:12:53.730ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39750
22752025-01-28T23:12:53.730ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22762025-01-28T23:12:53.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22772025-01-28T23:12:53.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109115 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39750 req_id = 04948f62-0dbd-4c24-998e-7c66865e215a response_code = 204 uri = /switch-ports
22782025-01-28T23:12:53.840ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
22792025-01-28T23:12:53.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62743 req_id = 42c05659-113f-4a7b-851d-ea1b324b59c0 response_code = 204 uri = /eip-gateways
22802025-01-28T23:12:53.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39750 req_id = bce52afc-59eb-486b-977e-07da862abd85 response_code = 200 uri = /network-bootstore-config
22812025-01-28T23:12:53.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62743 req_id = c381b6cb-7c51-41ab-ac02-c253e26b1f09 response_code = 204 uri = /vpc-routes
22822025-01-28T23:12:53.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54192
22832025-01-28T23:12:53.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54192 req_id = d2dfd1b0-ebab-4081-8d04-952d906640eb response_code = 200 uri = /vpc-routes
22842025-01-28T23:12:53.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45940
22852025-01-28T23:12:53.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45940 req_id = 1731defd-3acd-4ca8-978f-b2c3fdd5f2da response_code = 200 uri = /v2p
22862025-01-28T23:12:53.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34648
22872025-01-28T23:12:53.872ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22882025-01-28T23:12:53.915ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22892025-01-28T23:12:53.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97502 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34648 req_id = f809ea7b-6c7a-4d4b-bcca-9ab30df0b0e9 response_code = 204 uri = /switch-ports
22902025-01-28T23:12:53.969ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
22912025-01-28T23:12:53.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54192 req_id = 1619a2e8-61ea-4735-8548-cdabc467f14b response_code = 204 uri = /eip-gateways
22922025-01-28T23:12:53.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34648 req_id = 69ac8822-6d75-419b-ab46-2040e377c80b response_code = 200 uri = /network-bootstore-config
22932025-01-28T23:12:53.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36903
22942025-01-28T23:12:53.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36903 req_id = 1e6162eb-25c3-43a6-8db4-4534f29fb94c response_code = 200 uri = /v2p
22952025-01-28T23:12:54.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54192 req_id = 969d9cca-cfe5-461c-ae5e-6275eccd0e55 response_code = 204 uri = /vpc-routes
22962025-01-28T23:12:54.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36642
22972025-01-28T23:12:54.095ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22982025-01-28T23:12:54.132ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22992025-01-28T23:12:54.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94598 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36642 req_id = 99048958-2d5f-46df-94ad-8386093326ab response_code = 204 uri = /switch-ports
23002025-01-28T23:12:54.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36642 req_id = be050afd-b242-4b06-9bd3-61d75d7f48a9 response_code = 200 uri = /network-bootstore-config
23012025-01-28T23:13:05.633ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7081 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = b2f714b8-851e-4b55-a6b4-cd99117600dd response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
23022025-01-28T23:13:16.054ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60316
23032025-01-28T23:13:16.054ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60316 req_id = 26593601-c796-40a1-bfb9-1b70b25a254d response_code = 200 uri = /baseboard
23042025-01-28T23:13:23.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44744
23052025-01-28T23:13:23.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44744 req_id = 3828f97b-8af2-432d-bcd5-bf739959e6b8 response_code = 200 uri = /vpc-routes
23062025-01-28T23:13:23.396ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
23072025-01-28T23:13:23.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44744 req_id = 90e10a36-e5c7-4bc6-8cee-4832d7366c7e response_code = 204 uri = /eip-gateways
23082025-01-28T23:13:23.416ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41490
23092025-01-28T23:13:23.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41490 req_id = 3f81512e-4aff-4999-a2e1-f71688be2728 response_code = 200 uri = /v2p
23102025-01-28T23:13:23.425ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44744 req_id = 01bd3a1d-f259-4593-9815-ac4886aaa378 response_code = 204 uri = /vpc-routes
23112025-01-28T23:13:23.509ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63104
23122025-01-28T23:13:23.509ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23132025-01-28T23:13:23.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23142025-01-28T23:13:23.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102080 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63104 req_id = f1e8b1b6-c812-4e0e-b0ab-1de52c0d2223 response_code = 204 uri = /switch-ports
23152025-01-28T23:13:23.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56500
23162025-01-28T23:13:23.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63104 req_id = 2c7c38f0-7b49-4596-9904-3f9b61a0cd27 response_code = 200 uri = /network-bootstore-config
23172025-01-28T23:13:23.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56500 req_id = eb90474c-ce30-4d5f-818e-52b29849f217 response_code = 200 uri = /vpc-routes
23182025-01-28T23:13:23.666ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
23192025-01-28T23:13:23.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56500 req_id = 0a9cf6c0-303c-420a-8076-3f0d01c5e463 response_code = 204 uri = /eip-gateways
23202025-01-28T23:13:23.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59589
23212025-01-28T23:13:23.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59589 req_id = ddfe8789-5f0f-4c31-a2ff-0c4408b78bd7 response_code = 200 uri = /v2p
23222025-01-28T23:13:23.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60281
23232025-01-28T23:13:23.672ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23242025-01-28T23:13:23.713ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23252025-01-28T23:13:23.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103423 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60281 req_id = c3927042-8a6e-4a59-9cf3-da8b6270cf22 response_code = 204 uri = /switch-ports
23262025-01-28T23:13:23.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39800
23272025-01-28T23:13:23.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 469 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56500 req_id = 1aaeb7c0-ec5c-4e27-8a1a-f35a91e9eabc response_code = 204 uri = /vpc-routes
23282025-01-28T23:13:23.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60281 req_id = 64693309-4808-4444-8866-fd2c177370ea response_code = 200 uri = /network-bootstore-config
23292025-01-28T23:13:23.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39800 req_id = 9b91c73c-b82a-454f-80b5-7b4ba705164b response_code = 200 uri = /vpc-routes
23302025-01-28T23:13:23.824ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
23312025-01-28T23:13:23.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39800 req_id = 3ab0ec9e-7f98-4945-bd8d-590afa477c6f response_code = 204 uri = /eip-gateways
23322025-01-28T23:13:23.835ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52756
23332025-01-28T23:13:23.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52756 req_id = 5b7b34be-4e75-4626-90db-edc0b362fb7c response_code = 200 uri = /v2p
23342025-01-28T23:13:23.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39800 req_id = 1504dbc3-4638-411d-921e-a420e0fd8264 response_code = 204 uri = /vpc-routes
23352025-01-28T23:13:23.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50507
23362025-01-28T23:13:23.889ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23372025-01-28T23:13:23.923ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23382025-01-28T23:13:23.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83610 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50507 req_id = 53a8eadd-c57e-4c58-bc08-b60203e2663d response_code = 204 uri = /switch-ports
23392025-01-28T23:13:23.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50507 req_id = 40e09aa9-ae54-4cc5-bac2-1cf33aad77e1 response_code = 200 uri = /network-bootstore-config
23402025-01-28T23:13:35.635ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8720 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 3bb52f56-f8f5-4e92-b954-d9756b964ea2 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
23412025-01-28T23:13:46.087ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46912
23422025-01-28T23:13:46.088ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46912 req_id = dfa47ea1-77f2-46de-a33c-62d78de098e2 response_code = 200 uri = /baseboard
23432025-01-28T23:13:49.544ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23442025-01-28T23:13:49.544ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23452025-01-28T23:13:49.574ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1730, tv_nsec: 394191449 } time_to_next_cleanup = 599.99999499s
23462025-01-28T23:13:53.592ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56934
23472025-01-28T23:13:53.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56934 req_id = ab4c7c4a-4278-4ca9-ac4f-bb66d6e90a04 response_code = 200 uri = /v2p
23482025-01-28T23:13:53.602ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39451
23492025-01-28T23:13:53.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39451 req_id = e333bd2e-f138-4058-84a1-c2bce2aa8584 response_code = 200 uri = /vpc-routes
23502025-01-28T23:13:53.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43663
23512025-01-28T23:13:53.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 298 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43663 req_id = bae7654b-0ea0-419d-ab35-8c904bda6b58 response_code = 200 uri = /vpc-routes
23522025-01-28T23:13:53.702ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
23532025-01-28T23:13:53.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43663 req_id = 8e3fca72-885a-4b63-b055-cdb30d37380e response_code = 204 uri = /eip-gateways
23542025-01-28T23:13:53.704ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
23552025-01-28T23:13:53.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39451 req_id = 920a8c9b-a2f7-45a3-99ad-67c2a7ad278f response_code = 204 uri = /eip-gateways
23562025-01-28T23:13:53.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43663 req_id = 25e2eeb8-9f72-44de-92e6-19519c66350d response_code = 204 uri = /vpc-routes
23572025-01-28T23:13:53.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39451 req_id = 3c1905c0-5342-4d37-9cd4-50f6bb8b60b8 response_code = 204 uri = /vpc-routes
23582025-01-28T23:13:53.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59805
23592025-01-28T23:13:53.826ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23602025-01-28T23:13:53.879ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23612025-01-28T23:13:53.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134821 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59805 req_id = ab6efa2e-bd6d-4563-a5b3-377f9e4469e3 response_code = 204 uri = /switch-ports
23622025-01-28T23:13:53.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33996
23632025-01-28T23:13:53.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59805 req_id = fded4abf-693d-4ffd-993e-9842cb248585 response_code = 200 uri = /network-bootstore-config
23642025-01-28T23:13:53.961ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23652025-01-28T23:13:54.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62751
23662025-01-28T23:13:54.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 290 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62751 req_id = 5fb236d6-d20e-4717-b695-0cc30432b100 response_code = 200 uri = /v2p
23672025-01-28T23:13:54.012ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23682025-01-28T23:13:54.068ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34291
23692025-01-28T23:13:54.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34291 req_id = 7d9433b6-36b8-4134-9d4b-46fa55e42093 response_code = 200 uri = /vpc-routes
23702025-01-28T23:13:54.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123359 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33996 req_id = 93685531-cbf8-42f2-b392-deabb3f9fd21 response_code = 204 uri = /switch-ports
23712025-01-28T23:13:54.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33996 req_id = ddd07238-e2ee-488e-9220-5aa3178db64c response_code = 200 uri = /network-bootstore-config
23722025-01-28T23:13:54.114ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
23732025-01-28T23:13:54.114ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34291 req_id = e979fc77-9c9b-4dcc-b8b5-b625926f430b response_code = 204 uri = /eip-gateways
23742025-01-28T23:13:54.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34291 req_id = 402f0ef3-c8db-4399-9b2d-5f90005d2d45 response_code = 204 uri = /vpc-routes
23752025-01-28T23:13:54.168ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55168
23762025-01-28T23:13:54.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55168 req_id = f6593cfe-1df1-4795-b322-8527b8ec1093 response_code = 200 uri = /v2p
23772025-01-28T23:13:54.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64285
23782025-01-28T23:13:54.180ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23792025-01-28T23:13:54.217ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23802025-01-28T23:13:54.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95633 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64285 req_id = 3a70ce43-2203-41c3-8d22-deddb5362bfc response_code = 204 uri = /switch-ports
23812025-01-28T23:13:54.276ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64285 req_id = 6d14d8dd-7a2b-4a3e-8fb7-c2b521dba1e2 response_code = 200 uri = /network-bootstore-config
23822025-01-28T23:14:04.025ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23832025-01-28T23:14:05.634ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7608 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 72612199-0d2e-4b4c-819d-a44d9c53ea5c response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
23842025-01-28T23:14:16.121ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54721
23852025-01-28T23:14:16.121ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54721 req_id = e7f2f3a1-400c-4bee-a81c-a209473b1922 response_code = 200 uri = /baseboard
23862025-01-28T23:14:23.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57302
23872025-01-28T23:14:23.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57302 req_id = ddd69b3d-23aa-4400-a001-db17541ee3d7 response_code = 200 uri = /vpc-routes
23882025-01-28T23:14:23.414ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
23892025-01-28T23:14:23.414ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57302 req_id = 6550e9b7-b410-4cdb-b213-fdf7a1446a16 response_code = 204 uri = /eip-gateways
23902025-01-28T23:14:23.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50667
23912025-01-28T23:14:23.448ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50667 req_id = 6be89944-4d6a-4c83-919c-bed3b9cae09d response_code = 200 uri = /v2p
23922025-01-28T23:14:23.456ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57302 req_id = cc0ea8bf-444c-4d33-98aa-97e10d54e438 response_code = 204 uri = /vpc-routes
23932025-01-28T23:14:23.563ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41225
23942025-01-28T23:14:23.563ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23952025-01-28T23:14:23.613ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23962025-01-28T23:14:23.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140314 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41225 req_id = a861c69a-1de2-4e2b-a6e5-9113bb497707 response_code = 204 uri = /switch-ports
23972025-01-28T23:14:23.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48799
23982025-01-28T23:14:23.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48799 req_id = 5cc4fc07-c81e-4989-8a4f-66ed865dead2 response_code = 200 uri = /vpc-routes
23992025-01-28T23:14:23.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41225 req_id = ff3fffaf-9514-409a-a8a8-a49cd944a247 response_code = 200 uri = /network-bootstore-config
24002025-01-28T23:14:23.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39510
24012025-01-28T23:14:23.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39510 req_id = 6abba887-6903-44ae-b65c-ef26f84b9c65 response_code = 200 uri = /v2p
24022025-01-28T23:14:23.764ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
24032025-01-28T23:14:23.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48799 req_id = 310faef5-4aec-48ef-82b6-1c31bb8e3f06 response_code = 204 uri = /eip-gateways
24042025-01-28T23:14:23.773ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48799 req_id = 5a5c46f8-15e7-4d97-b4f2-1ce42c405d3a response_code = 204 uri = /vpc-routes
24052025-01-28T23:14:23.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39448
24062025-01-28T23:14:23.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39448 req_id = 9c5c7d68-3da6-4e7c-83f7-ac704a9d49d7 response_code = 200 uri = /vpc-routes
24072025-01-28T23:14:23.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45825
24082025-01-28T23:14:23.802ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24092025-01-28T23:14:23.842ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24102025-01-28T23:14:23.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45825 req_id = 87810667-4746-429e-888b-1b84faadc8e4 response_code = 204 uri = /switch-ports
24112025-01-28T23:14:23.901ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
24122025-01-28T23:14:23.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60331
24132025-01-28T23:14:23.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39448 req_id = ba9b313b-ae8a-4d5b-8f7c-2899ff552e85 response_code = 204 uri = /eip-gateways
24142025-01-28T23:14:23.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45825 req_id = 0a85a77d-1e49-4254-beda-bca6b2de127f response_code = 200 uri = /network-bootstore-config
24152025-01-28T23:14:23.902ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24162025-01-28T23:14:23.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40249
24172025-01-28T23:14:23.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40249 req_id = d76fb802-322f-452a-8c01-553747650c32 response_code = 200 uri = /v2p
24182025-01-28T23:14:23.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39448 req_id = c7b81d2f-61d7-4e3c-82b4-9ab13d9a29b7 response_code = 204 uri = /vpc-routes
24192025-01-28T23:14:23.939ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24202025-01-28T23:14:23.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83141 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60331 req_id = 5442c7ab-6154-4d16-8e37-fa894a7ca3af response_code = 204 uri = /switch-ports
24212025-01-28T23:14:23.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60331 req_id = 658ec1a9-5ffe-4d27-88e3-dcdc4d49abc3 response_code = 200 uri = /network-bootstore-config
24222025-01-28T23:14:35.635ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7642 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 521ee783-2b34-45d8-b38f-11ca359659fc response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
24232025-01-28T23:14:46.155ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33699
24242025-01-28T23:14:46.155ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33699 req_id = 0fc2bd61-7721-4d98-a097-e3b34c975538 response_code = 200 uri = /baseboard
24252025-01-28T23:14:53.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37036
24262025-01-28T23:14:53.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37036 req_id = b8a6a49e-2d45-49c7-960e-c46b091c8a1a response_code = 200 uri = /v2p
24272025-01-28T23:14:53.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39733
24282025-01-28T23:14:53.581ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39733 req_id = 6141b2d2-342c-49ec-95e6-8ab60c3657ce response_code = 200 uri = /vpc-routes
24292025-01-28T23:14:53.652ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
24302025-01-28T23:14:53.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39733 req_id = 4cf97293-303b-4c52-ad28-92e09be98b02 response_code = 204 uri = /eip-gateways
24312025-01-28T23:14:53.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 309 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39733 req_id = 1e74a2c8-55f2-4835-900b-97b5b5121737 response_code = 204 uri = /vpc-routes
24322025-01-28T23:14:53.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41368
24332025-01-28T23:14:53.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41368 req_id = 7055003c-4e29-47c4-a033-d0bc8317af90 response_code = 200 uri = /vpc-routes
24342025-01-28T23:14:53.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
24352025-01-28T23:14:53.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41368 req_id = 495d6486-be85-4426-8de9-62f81e55bf66 response_code = 204 uri = /eip-gateways
24362025-01-28T23:14:53.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41368 req_id = a42c98f6-9f30-4d2e-9bf4-49bfff225ddf response_code = 204 uri = /vpc-routes
24372025-01-28T23:14:53.853ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33343
24382025-01-28T23:14:53.853ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24392025-01-28T23:14:53.891ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24402025-01-28T23:14:53.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33343 req_id = d25c48c7-9c3c-4f4a-8d77-22674f9a0abc response_code = 204 uri = /switch-ports
24412025-01-28T23:14:53.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33767
24422025-01-28T23:14:53.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33767 req_id = 4fe54ed5-fea4-4b9b-8fbc-94fbc47bcc2c response_code = 200 uri = /vpc-routes
24432025-01-28T23:14:53.969ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33343 req_id = 0438da4f-29b3-431a-a0c1-492a1f614da1 response_code = 200 uri = /network-bootstore-config
24442025-01-28T23:14:53.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54064
24452025-01-28T23:14:53.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54064 req_id = 13d30f6e-806d-4acf-8355-ac40885b179b response_code = 200 uri = /v2p
24462025-01-28T23:14:54.011ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
24472025-01-28T23:14:54.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33767 req_id = c6cac7ab-fa1f-440d-814d-8cbc71f9ed3e response_code = 204 uri = /eip-gateways
24482025-01-28T23:14:54.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33767 req_id = c1584e10-6372-4690-90a9-37eddbc78164 response_code = 204 uri = /vpc-routes
24492025-01-28T23:14:54.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56020
24502025-01-28T23:14:54.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24512025-01-28T23:14:54.093ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24522025-01-28T23:14:54.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88981 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56020 req_id = d03eb0d8-27d3-4d1c-b513-de54fe887668 response_code = 204 uri = /switch-ports
24532025-01-28T23:14:54.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54023
24542025-01-28T23:14:54.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61004
24552025-01-28T23:14:54.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61004 req_id = 06e72eb3-7ddf-4362-b28d-965a4d3a08bb response_code = 200 uri = /v2p
24562025-01-28T23:14:54.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56020 req_id = de5e6173-d7b7-42f5-b61a-dcede7f2d763 response_code = 200 uri = /network-bootstore-config
24572025-01-28T23:14:54.144ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24582025-01-28T23:14:54.182ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24592025-01-28T23:14:54.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96316 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54023 req_id = da0cc382-e4cd-49ac-9332-96e27db4d0ff response_code = 204 uri = /switch-ports
24602025-01-28T23:14:54.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54023 req_id = 9f36c736-121d-4b8c-8cd5-58050e4a3561 response_code = 200 uri = /network-bootstore-config
24612025-01-28T23:15:05.635ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7460 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 0a85a395-529e-444e-9e26-84c6aba564a5 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
24622025-01-28T23:15:16.190ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35949
24632025-01-28T23:15:16.190ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:35949 req_id = f3f1a7e0-e057-4081-a7a5-b936fc798ba7 response_code = 200 uri = /baseboard
24642025-01-28T23:15:23.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36330
24652025-01-28T23:15:23.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36330 req_id = ba18e5d6-023d-46d8-805d-29093babad96 response_code = 200 uri = /vpc-routes
24662025-01-28T23:15:23.309ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
24672025-01-28T23:15:23.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36330 req_id = 04581184-4106-4a79-9700-dbc05550a3f6 response_code = 204 uri = /eip-gateways
24682025-01-28T23:15:23.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36330 req_id = 350b554a-3349-473a-84cd-35452c977a67 response_code = 204 uri = /vpc-routes
24692025-01-28T23:15:23.457ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60663
24702025-01-28T23:15:23.458ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60663 req_id = 7619d824-a392-41fe-87f9-346e16e25017 response_code = 200 uri = /v2p
24712025-01-28T23:15:23.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53319
24722025-01-28T23:15:23.521ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24732025-01-28T23:15:23.558ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24742025-01-28T23:15:23.626ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105147 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53319 req_id = b2864269-5561-478a-b533-ab34d5b17d80 response_code = 204 uri = /switch-ports
24752025-01-28T23:15:23.627ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35537
24762025-01-28T23:15:23.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35537 req_id = bf738aeb-ce0b-4c14-8f5c-d1c2684aef34 response_code = 200 uri = /vpc-routes
24772025-01-28T23:15:23.627ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53319 req_id = 118fa117-a12c-4cf3-aa3c-faa6515cb548 response_code = 200 uri = /network-bootstore-config
24782025-01-28T23:15:23.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35518
24792025-01-28T23:15:23.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35518 req_id = ac0f3ef2-be92-46ae-838d-0d9ec3a5caff response_code = 200 uri = /v2p
24802025-01-28T23:15:23.684ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
24812025-01-28T23:15:23.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35537 req_id = c5f74927-6ad6-4d70-a940-b0771c9dc80b response_code = 204 uri = /eip-gateways
24822025-01-28T23:15:23.688ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44589
24832025-01-28T23:15:23.688ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24842025-01-28T23:15:23.730ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24852025-01-28T23:15:23.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98115 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44589 req_id = c28f821b-eb28-4f9c-9e9c-05b790ed4c96 response_code = 204 uri = /switch-ports
24862025-01-28T23:15:23.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44589 req_id = d2bf9b0f-cb1a-4535-8059-19e2824bce64 response_code = 200 uri = /network-bootstore-config
24872025-01-28T23:15:23.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 513 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35537 req_id = 0448a678-1b87-4ea6-88ff-76351722be6f response_code = 204 uri = /vpc-routes
24882025-01-28T23:15:23.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52817
24892025-01-28T23:15:23.880ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52817 req_id = 2bb91910-4794-4001-8821-0200bd234be2 response_code = 200 uri = /v2p
24902025-01-28T23:15:23.909ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33801
24912025-01-28T23:15:23.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33801 req_id = 943eaa1e-b0dd-4e09-9f57-4d51b73cf876 response_code = 200 uri = /vpc-routes
24922025-01-28T23:15:23.955ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
24932025-01-28T23:15:23.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33801 req_id = 34c945dd-94b5-4e23-8cbb-3265400eb8d2 response_code = 204 uri = /eip-gateways
24942025-01-28T23:15:23.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33801 req_id = 7d6499f9-d873-4e9c-916e-dfc95a2dc1db response_code = 204 uri = /vpc-routes
24952025-01-28T23:15:24.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45654
24962025-01-28T23:15:24.015ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24972025-01-28T23:15:24.053ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24982025-01-28T23:15:24.107ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92242 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45654 req_id = c058e288-b9f3-4d58-849a-dfd2d926176d response_code = 204 uri = /switch-ports
24992025-01-28T23:15:24.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45654 req_id = e88796fc-eb72-4a3f-8a7c-f5d61e73f77b response_code = 200 uri = /network-bootstore-config
25002025-01-28T23:15:35.636ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7827 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 0531fa80-dd2c-4948-b374-db9f2ad537aa response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
25012025-01-28T23:15:46.227ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40268
25022025-01-28T23:15:46.227ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40268 req_id = 084d5bdc-c506-45ec-ac73-a220761f2724 response_code = 200 uri = /baseboard
25032025-01-28T23:15:53.567ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53243
25042025-01-28T23:15:53.567ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53243 req_id = 91b78a76-8192-4d1d-b04c-dc668f5c157b response_code = 200 uri = /vpc-routes
25052025-01-28T23:15:53.623ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
25062025-01-28T23:15:53.623ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53243 req_id = 24a9abab-1f4d-4697-ba87-5a9e77b5bf0c response_code = 204 uri = /eip-gateways
25072025-01-28T23:15:53.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 337 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53243 req_id = b54ba9ab-a2c5-4189-9642-60f39d1d25d3 response_code = 204 uri = /vpc-routes
25082025-01-28T23:15:53.777ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35626
25092025-01-28T23:15:53.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35626 req_id = 337fb8ce-b9a5-4c09-aeb9-78681f1613b1 response_code = 200 uri = /v2p
25102025-01-28T23:15:53.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58160
25112025-01-28T23:15:53.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25122025-01-28T23:15:53.784ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25132025-01-28T23:15:53.784ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
25142025-01-28T23:15:53.784ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
25152025-01-28T23:15:53.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45056
25162025-01-28T23:15:53.795ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25172025-01-28T23:15:53.799ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25182025-01-28T23:15:53.799ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68044c5c-97c7-414c-b44a-b8251f523a8f
25192025-01-28T23:15:53.829ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25202025-01-28T23:15:53.829ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_099773d5-5f69-4f65-8f86-75c48d557e90
25212025-01-28T23:15:53.838ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25222025-01-28T23:15:53.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36480
25232025-01-28T23:15:53.859ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39698
25242025-01-28T23:15:53.870ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25252025-01-28T23:15:53.870ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68
25262025-01-28T23:15:53.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 590 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36480 req_id = 715c55f7-2523-4375-ab46-e79c73059c9a response_code = 200 uri = /vpc-routes
25272025-01-28T23:15:53.874ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 713 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39698 req_id = b10098cb-a63c-41db-86be-8f3fe435705e response_code = 200 uri = /vpc-routes
25282025-01-28T23:15:53.918ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25292025-01-28T23:15:53.918ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19
25302025-01-28T23:15:53.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147962 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45056 req_id = a08d53c1-4e75-42b3-877b-23badbbaa7b8 response_code = 204 uri = /switch-ports
25312025-01-28T23:15:53.943ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
25322025-01-28T23:15:53.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36480 req_id = 9ca23bce-7538-443e-8d11-6660d5cc495a response_code = 204 uri = /eip-gateways
25332025-01-28T23:15:53.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45056 req_id = dc3b6f02-d564-43d7-a6f4-ee2242d5cd88 response_code = 200 uri = /network-bootstore-config
25342025-01-28T23:15:53.949ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60849
25352025-01-28T23:15:53.949ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25362025-01-28T23:15:53.954ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25372025-01-28T23:15:53.954ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_21294dfd-a58f-42c6-a41c-8b148c95a198
25382025-01-28T23:15:53.992ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25392025-01-28T23:15:53.992ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ff6949fe-2851-437a-b6e9-cb91f2325920
25402025-01-28T23:15:53.998ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25412025-01-28T23:15:54.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45007
25422025-01-28T23:15:54.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
25432025-01-28T23:15:54.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39698 req_id = 1a097f32-c1b3-4001-9bb5-98233d4007de response_code = 204 uri = /eip-gateways
25442025-01-28T23:15:54.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56760
25452025-01-28T23:15:54.022ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25462025-01-28T23:15:54.022ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25472025-01-28T23:15:54.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36480 req_id = f6fd6a9d-abfe-43ad-82c3-527e748e1db7 response_code = 204 uri = /vpc-routes
25482025-01-28T23:15:54.022ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25492025-01-28T23:15:54.022ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25502025-01-28T23:15:54.022ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25512025-01-28T23:15:54.022ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25522025-01-28T23:15:54.022ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25532025-01-28T23:15:54.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 947 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45007 req_id = b08255eb-9f55-4154-a430-1e5f3d52ab62 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25542025-01-28T23:15:54.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25552025-01-28T23:15:54.022ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25562025-01-28T23:15:54.023ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
25572025-01-28T23:15:54.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40034
25582025-01-28T23:15:54.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40034 req_id = 2836ec60-66b9-48c3-ad71-2dc02101aed2 response_code = 200 uri = /v2p
25592025-01-28T23:15:54.023ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
25602025-01-28T23:15:54.024ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25612025-01-28T23:15:54.030ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_46e85043-614f-4a55-8660-1ccd892d22b2
25622025-01-28T23:15:54.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1062 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39698 req_id = 19e72ca0-4be5-4ff3-a764-7db44425a06b response_code = 204 uri = /vpc-routes
25632025-01-28T23:15:54.049ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25642025-01-28T23:15:54.049ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68044c5c-97c7-414c-b44a-b8251f523a8f
25652025-01-28T23:15:54.080ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25662025-01-28T23:15:54.081ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_099773d5-5f69-4f65-8f86-75c48d557e90
25672025-01-28T23:15:54.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138496 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:60849 req_id = cee9131a-179d-4e3e-8311-9dc2cf8abd4b response_code = 204 uri = /switch-ports
25682025-01-28T23:15:54.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60849 req_id = 66f8d788-1fb3-4550-a12f-772a6be67ebc response_code = 200 uri = /network-bootstore-config
25692025-01-28T23:15:54.096ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25702025-01-28T23:15:54.096ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b6f4a7de-ae5d-4497-bee3-21826d504667
25712025-01-28T23:15:54.113ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25722025-01-28T23:15:54.113ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68
25732025-01-28T23:15:54.133ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25742025-01-28T23:15:54.133ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79dc877f-201a-4a6a-a185-dc64a57ed603
25752025-01-28T23:15:54.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 363166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58160 req_id = 03ff8ef6-6841-4404-a2c8-4467c0b81a3c response_code = 200 uri = /inventory
25762025-01-28T23:15:54.148ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25772025-01-28T23:15:54.148ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19
25782025-01-28T23:15:54.171ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25792025-01-28T23:15:54.171ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_21294dfd-a58f-42c6-a41c-8b148c95a198
25802025-01-28T23:15:54.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39903
25812025-01-28T23:15:54.183ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25822025-01-28T23:15:54.183ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25832025-01-28T23:15:54.183ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/config/omicron-zones.json file = common/src/ledger.rs:177
25842025-01-28T23:15:54.188ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/config/omicron-zones.json file = common/src/ledger.rs:177
25852025-01-28T23:15:54.194ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25862025-01-28T23:15:54.194ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ff6949fe-2851-437a-b6e9-cb91f2325920
25872025-01-28T23:15:54.209ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 68044c5c-97c7-414c-b44a-b8251f523a8f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25882025-01-28T23:15:54.209ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_68044c5c-97c7-414c-b44a-b8251f523a8f
25892025-01-28T23:15:54.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37209
25902025-01-28T23:15:54.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37209 req_id = 0abd8346-00be-4174-ab03-15a547e725c3 response_code = 200 uri = /v2p
25912025-01-28T23:15:54.235ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 099773d5-5f69-4f65-8f86-75c48d557e90 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25922025-01-28T23:15:54.235ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_099773d5-5f69-4f65-8f86-75c48d557e90
25932025-01-28T23:15:54.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39275
25942025-01-28T23:15:54.243ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25952025-01-28T23:15:54.243ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25962025-01-28T23:15:54.243ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25972025-01-28T23:15:54.243ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25982025-01-28T23:15:54.243ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25992025-01-28T23:15:54.243ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26002025-01-28T23:15:54.243ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26012025-01-28T23:15:54.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 431 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39275 req_id = 7f18f1c3-de89-479d-9d18-0eb0eabca9e6 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26022025-01-28T23:15:54.248ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26032025-01-28T23:15:54.248ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_46e85043-614f-4a55-8660-1ccd892d22b2
26042025-01-28T23:15:54.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26052025-01-28T23:15:54.267ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68
26062025-01-28T23:15:54.280ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26072025-01-28T23:15:54.280ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b6f4a7de-ae5d-4497-bee3-21826d504667
26082025-01-28T23:15:54.291ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41006
26092025-01-28T23:15:54.291ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 22dfa0a1-4917-4468-8a58-ef4c04746605, kind: Service { id: 4335af1f-16a7-49b3-8b71-d223b1685563 }, name: Name("external-dns-4335af1f-16a7-49b3-8b71-d223b1685563"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 156, 236])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e35dd77e-2a34-44d1-9129-f6c47779c2fe, kind: Service { id: cc4afcc9-6153-4509-98bd-06bc1805f80c }, name: Name("external-dns-cc4afcc9-6153-4509-98bd-06bc1805f80c"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 253, 210])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0836ae40-70e1-45af-a8e9-b6e729a4a484, kind: Service { id: 69eeab44-9aa8-404e-a0e1-08c536dc6600 }, name: Name("nexus-69eeab44-9aa8-404e-a0e1-08c536dc6600"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 61])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 4e77a5aa-ee5f-4339-ab1d-fb2313aee107, kind: Service { id: e43f34ea-a717-45f9-a508-a556ea99a693 }, name: Name("nexus-e43f34ea-a717-45f9-a508-a556ea99a693"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 173, 192])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e4330d6d-c3e1-41a3-8c0b-e3064cca2431, kind: Service { id: 04518a99-18ce-4d83-86ed-64c06a57b07c }, name: Name("nexus-04518a99-18ce-4d83-86ed-64c06a57b07c"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 205, 252])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26102025-01-28T23:15:54.291ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26112025-01-28T23:15:54.294ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26122025-01-28T23:15:54.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26132025-01-28T23:15:54.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26142025-01-28T23:15:54.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26152025-01-28T23:15:54.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26162025-01-28T23:15:54.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7372 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41006 req_id = 91488099-19ca-4609-b955-00ea9522438e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26172025-01-28T23:15:54.303ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26182025-01-28T23:15:54.303ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79dc877f-201a-4a6a-a185-dc64a57ed603
26192025-01-28T23:15:54.314ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26202025-01-28T23:15:54.314ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19
26212025-01-28T23:15:54.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 295994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56760 req_id = 120de322-2d3a-416e-b0d6-59aeafb2b437 response_code = 200 uri = /inventory
26222025-01-28T23:15:54.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36211
26232025-01-28T23:15:54.337ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26242025-01-28T23:15:54.340ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 21294dfd-a58f-42c6-a41c-8b148c95a198 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26252025-01-28T23:15:54.340ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_21294dfd-a58f-42c6-a41c-8b148c95a198
26262025-01-28T23:15:54.368ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: ff6949fe-2851-437a-b6e9-cb91f2325920 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26272025-01-28T23:15:54.368ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_ff6949fe-2851-437a-b6e9-cb91f2325920
26282025-01-28T23:15:54.377ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26292025-01-28T23:15:54.393ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 46e85043-614f-4a55-8660-1ccd892d22b2 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26302025-01-28T23:15:54.393ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_46e85043-614f-4a55-8660-1ccd892d22b2
26312025-01-28T23:15:54.420ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b6f4a7de-ae5d-4497-bee3-21826d504667 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26322025-01-28T23:15:54.420ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b6f4a7de-ae5d-4497-bee3-21826d504667
26332025-01-28T23:15:54.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36211 req_id = 646c8fd1-540e-43a4-98e6-73624bc2d000 response_code = 204 uri = /switch-ports
26342025-01-28T23:15:54.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36211 req_id = 08e2f50d-960b-4ea0-9ea8-455aee8a6e1e response_code = 200 uri = /network-bootstore-config
26352025-01-28T23:15:54.448ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79dc877f-201a-4a6a-a185-dc64a57ed603 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26362025-01-28T23:15:54.448ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79dc877f-201a-4a6a-a185-dc64a57ed603
26372025-01-28T23:15:54.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287591 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39903 req_id = 1582fe99-1cd1-4142-b819-04bea37cbffe response_code = 200 uri = /inventory
26382025-01-28T23:16:05.635ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7455 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = ea3b8f66-e3f2-42f9-aa57-80a0ed7fcbbe response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
26392025-01-28T23:16:16.260ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62604
26402025-01-28T23:16:16.261ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62604 req_id = e17c3779-93d5-4552-8329-f82525bb9d25 response_code = 200 uri = /baseboard
26412025-01-28T23:16:23.358ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33353
26422025-01-28T23:16:23.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33353 req_id = 9800e4d3-80d2-4dd3-9af6-acc6523a3396 response_code = 200 uri = /vpc-routes
26432025-01-28T23:16:23.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
26442025-01-28T23:16:23.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33353 req_id = 5c53e0fc-215e-49e4-bfdf-9c790061977a response_code = 204 uri = /eip-gateways
26452025-01-28T23:16:23.447ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53606
26462025-01-28T23:16:23.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53606 req_id = 4ff40fd8-c390-4ef5-b182-35247cf78e04 response_code = 200 uri = /v2p
26472025-01-28T23:16:23.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33353 req_id = 6f0e1c5d-eb64-40a8-9455-009f47b17ec0 response_code = 204 uri = /vpc-routes
26482025-01-28T23:16:23.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57225
26492025-01-28T23:16:23.482ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26502025-01-28T23:16:23.524ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26512025-01-28T23:16:23.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101025 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57225 req_id = 565cb51c-3cf7-4de0-9a05-8b8667daf9f6 response_code = 204 uri = /switch-ports
26522025-01-28T23:16:23.583ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57225 req_id = c437bd3f-ef26-4c57-9412-46e6f1129a21 response_code = 200 uri = /network-bootstore-config
26532025-01-28T23:16:23.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33605
26542025-01-28T23:16:23.625ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33605 req_id = e658ba94-40a4-4930-8b93-8394deceda5f response_code = 200 uri = /vpc-routes
26552025-01-28T23:16:23.644ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
26562025-01-28T23:16:23.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33605 req_id = 99117034-db39-4202-ac3e-0c472fd791af response_code = 204 uri = /eip-gateways
26572025-01-28T23:16:23.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33605 req_id = 1cb266a1-3115-49cc-8690-9d19ef2ef0e4 response_code = 204 uri = /vpc-routes
26582025-01-28T23:16:23.697ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46365
26592025-01-28T23:16:23.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46365 req_id = cb12d7e2-8c5e-4734-96d8-a49317508458 response_code = 200 uri = /v2p
26602025-01-28T23:16:23.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41360
26612025-01-28T23:16:23.766ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41360 req_id = 7eebe481-8c92-4f97-82cf-175f872ef6c2 response_code = 200 uri = /vpc-routes
26622025-01-28T23:16:23.781ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
26632025-01-28T23:16:23.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41360 req_id = ac8ca520-741f-4bf1-8ed4-6be9c1167c4d response_code = 204 uri = /eip-gateways
26642025-01-28T23:16:23.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34427
26652025-01-28T23:16:23.782ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26662025-01-28T23:16:23.824ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26672025-01-28T23:16:23.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99632 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34427 req_id = b6d8e9ff-ada4-4b7c-a57e-3fea2a0bc065 response_code = 204 uri = /switch-ports
26682025-01-28T23:16:23.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59562
26692025-01-28T23:16:23.882ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63921
26702025-01-28T23:16:23.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34427 req_id = 604fe3b9-7e23-471f-9596-d29eb778ab31 response_code = 200 uri = /network-bootstore-config
26712025-01-28T23:16:23.882ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 461 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41360 req_id = 351f5f55-886e-47c6-865e-715d2361db28 response_code = 204 uri = /vpc-routes
26722025-01-28T23:16:23.883ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26732025-01-28T23:16:23.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63921 req_id = dc160197-69c3-41b9-bbfd-57af827aa667 response_code = 200 uri = /v2p
26742025-01-28T23:16:23.921ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26752025-01-28T23:16:23.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59562 req_id = 470f45a3-50dc-4470-a8a2-1616c522484f response_code = 204 uri = /switch-ports
26762025-01-28T23:16:23.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59562 req_id = 57d47773-02cb-481b-b831-c3df2703fdf9 response_code = 200 uri = /network-bootstore-config
26772025-01-28T23:16:35.636ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7431 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 9bf14635-478d-4886-9b67-0baec2ddc218 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
26782025-01-28T23:16:46.293ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43130
26792025-01-28T23:16:46.293ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43130 req_id = c233aac9-b523-4db9-83b2-ac00897514af response_code = 200 uri = /baseboard
26802025-01-28T23:16:53.413ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39870
26812025-01-28T23:16:53.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39870 req_id = 575cdc60-9e13-4205-9e68-29881e8fafef response_code = 200 uri = /vpc-routes
26822025-01-28T23:16:53.494ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
26832025-01-28T23:16:53.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39870 req_id = 4fe9227b-b18c-47c3-82f6-8a5951230542 response_code = 204 uri = /eip-gateways
26842025-01-28T23:16:53.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39870 req_id = 5b9e60c7-c519-4d1e-87f1-15e1aa1c4cc1 response_code = 204 uri = /vpc-routes
26852025-01-28T23:16:53.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51456
26862025-01-28T23:16:53.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51456 req_id = ec50f723-6cd8-49cd-a7d9-ce1d4c18e7f4 response_code = 200 uri = /v2p
26872025-01-28T23:16:53.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61447
26882025-01-28T23:16:53.678ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26892025-01-28T23:16:53.727ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26902025-01-28T23:16:53.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111991 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61447 req_id = b99b6cf4-7104-44ef-8b7b-9a0a0aa9e89d response_code = 204 uri = /switch-ports
26912025-01-28T23:16:53.790ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57719
26922025-01-28T23:16:53.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57719 req_id = 2f831617-2c9a-4c0c-918e-0ca693fb35ae response_code = 200 uri = /vpc-routes
26932025-01-28T23:16:53.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61447 req_id = b581c38b-7f58-4db6-ba74-8a6758fec617 response_code = 200 uri = /network-bootstore-config
26942025-01-28T23:16:53.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41684
26952025-01-28T23:16:53.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41684 req_id = dfa43cba-4a72-4743-8d5d-08853e4a7f87 response_code = 200 uri = /v2p
26962025-01-28T23:16:53.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57750
26972025-01-28T23:16:53.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57750 req_id = 14db44ca-4a87-4c07-9b42-ebce83d5bb85 response_code = 200 uri = /v2p
26982025-01-28T23:16:53.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38869
26992025-01-28T23:16:53.932ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27002025-01-28T23:16:53.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27012025-01-28T23:16:54.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97734 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38869 req_id = c9ed2d10-045b-4d4e-8fb2-a86f609303df response_code = 204 uri = /switch-ports
27022025-01-28T23:16:54.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
27032025-01-28T23:16:54.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61444
27042025-01-28T23:16:54.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57719 req_id = b5f267ed-a9fb-4fc6-b8b4-d1d73ffa353a response_code = 204 uri = /eip-gateways
27052025-01-28T23:16:54.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38869 req_id = 9c1c6e9b-1f03-4f5a-a41e-03990f2cff4d response_code = 200 uri = /network-bootstore-config
27062025-01-28T23:16:54.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61444 req_id = caf77266-a9dd-4925-9e3e-f66db62408d8 response_code = 200 uri = /vpc-routes
27072025-01-28T23:16:54.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57719 req_id = 8c9e5266-f0ed-41e1-83e1-1f222c1053da response_code = 204 uri = /vpc-routes
27082025-01-28T23:16:54.046ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
27092025-01-28T23:16:54.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61444 req_id = eed6ce25-0449-43ec-a347-f5eb7237cc10 response_code = 204 uri = /eip-gateways
27102025-01-28T23:16:54.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34904
27112025-01-28T23:16:54.053ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27122025-01-28T23:16:54.087ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27132025-01-28T23:16:54.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34904 req_id = 7d60f227-938c-40cb-8679-b7f9d89061e5 response_code = 204 uri = /switch-ports
27142025-01-28T23:16:54.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34904 req_id = d3c84c1c-8440-4581-af65-8d371c0ebf25 response_code = 200 uri = /network-bootstore-config
27152025-01-28T23:16:54.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 473 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61444 req_id = ae6b0109-7aa3-4019-81dc-f93ef93c5a8c response_code = 204 uri = /vpc-routes
27162025-01-28T23:17:05.637ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9126 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = b096f865-ee31-43fe-834a-d9e54ae849aa response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
27172025-01-28T23:17:11.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59274
27182025-01-28T23:17:11.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59274 req_id = 76e8ae1d-2566-47ca-8419-539c4c56d861 response_code = 200 uri = /v2p
27192025-01-28T23:17:11.173ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(11583525) }
27202025-01-28T23:17:11.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59274 req_id = 658aeb3c-7637-4622-92d1-fa4842c14017 response_code = 204 uri = /v2p
27212025-01-28T23:17:11.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33736
27222025-01-28T23:17:11.453ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 46b648db-978e-4e54-9504-aff6f08e6f3c, kind: Instance { id: 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11583525), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 46b648db-978e-4e54-9504-aff6f08e6f3c, kind: Instance { id: 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11583525), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 46b648db-978e-4e54-9504-aff6f08e6f3c, kind: Instance { id: 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11583525), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11583525))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 46b648db-978e-4e54-9504-aff6f08e6f3c, kind: Instance { id: 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11583525), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 86db2b9f-fdcb-44b2-968e-c51b1a931c64, slot: 0, read_only: false, vcr_json: .., name: "disk-3e1d2644f7" }], boot_settings: Some(InstanceBootSettings { order: [86db2b9f-fdcb-44b2-968e-c51b1a931c64] }), cloud_init_bytes: Some(..) } instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 metadata = InstanceMetadata { silo_id: c2eec470-bcb2-4442-b253-d1c6130bb77f, project_id: b9dfcfa8-d4ee-43d0-9e65-e995950311e2 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-28T23:17:11.445971700Z }
27232025-01-28T23:17:11.453ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 migration_id = None propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27242025-01-28T23:17:11.453ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 migration_id = None propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 46b648db-978e-4e54-9504-aff6f08e6f3c, kind: Instance { id: 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11583525), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 46b648db-978e-4e54-9504-aff6f08e6f3c, kind: Instance { id: 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11583525), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 46b648db-978e-4e54-9504-aff6f08e6f3c, kind: Instance { id: 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11583525), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(11583525))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 46b648db-978e-4e54-9504-aff6f08e6f3c, kind: Instance { id: 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(11583525), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 86db2b9f-fdcb-44b2-968e-c51b1a931c64, slot: 0, read_only: false, vcr_json: .., name: "disk-3e1d2644f7" }], boot_settings: Some(InstanceBootSettings { order: [86db2b9f-fdcb-44b2-968e-c51b1a931c64] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-28T23:17:11.445971700Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27252025-01-28T23:17:11.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9428 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33736 req_id = 835f3c1a-8982-4ea0-a93a-fd47ab9fcfb4 response_code = 200 uri = /vmms/6d93c889-9f0f-48bb-b91c-51843863ff6b
27262025-01-28T23:17:11.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56493
27272025-01-28T23:17:11.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8590 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56493 req_id = 689cf60f-77df-45b4-a7f3-a470303b5cfc response_code = 200 uri = /vmms/6d93c889-9f0f-48bb-b91c-51843863ff6b/state
27282025-01-28T23:17:11.695ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 11583525 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27292025-01-28T23:17:11.695ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27302025-01-28T23:17:11.738ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b file = illumos-utils/src/zone.rs:325 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27312025-01-28T23:17:11.760ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b file = illumos-utils/src/zone.rs:363 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27322025-01-28T23:17:11.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43272
27332025-01-28T23:17:11.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43272 req_id = be53dd4c-628b-4f0a-aa52-6b5e423e1e99 response_code = 200 uri = /vpc-routes
27342025-01-28T23:17:11.887ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {46b648db-978e-4e54-9504-aff6f08e6f3c: {10.151.1.175: {f1560151-7b77-44db-bed6-3f4292b6ac8e}, 10.151.1.176: {f1560151-7b77-44db-bed6-3f4292b6ac8e}}} }
27352025-01-28T23:17:13.218ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27362025-01-28T23:17:13.218ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b zone file = illumos-utils/src/running_zone.rs:488 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27372025-01-28T23:17:13.467ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 45.140605ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27382025-01-28T23:17:13.522ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 67.344516ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27392025-01-28T23:17:13.616ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 262.354818ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27402025-01-28T23:17:13.891ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 355.362896ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27412025-01-28T23:17:14.260ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 617.524163ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27422025-01-28T23:17:14.890ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 747.135098ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27432025-01-28T23:17:15.647ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 1.019364628s file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27442025-01-28T23:17:16.330ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64443
27452025-01-28T23:17:16.330ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64443 req_id = 2d834b7f-868d-41fb-9f10-d1fe11bd8d5c response_code = 200 uri = /baseboard
27462025-01-28T23:17:16.679ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 1.132324068s file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27472025-01-28T23:17:17.823ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 1.177723102s file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27482025-01-28T23:17:19.011ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 696.842798ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27492025-01-28T23:17:19.720ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 823.203144ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b zone = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
27502025-01-28T23:17:20.569ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b file = sled-agent/src/instance.rs:2068 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27512025-01-28T23:17:20.577ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 34.15378ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27522025-01-28T23:17:20.621ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 81.9065ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27532025-01-28T23:17:20.713ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 207.873682ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27542025-01-28T23:17:20.932ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 250.787653ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27552025-01-28T23:17:21.194ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b") failed: Property not found. retry in 833.716543ms file = illumos-utils/src/svc.rs:42 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27562025-01-28T23:17:22.039ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27572025-01-28T23:17:22.110ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27582025-01-28T23:17:22.185ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27592025-01-28T23:17:22.185ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
27602025-01-28T23:17:22.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10298589 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43272 req_id = aaa5c5d3-c866-49ff-905e-550f566edcb4 response_code = 204 uri = /eip-gateways
27612025-01-28T23:17:22.185ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-28T23:17:22.185950434Z } file = sled-agent/src/instance.rs:781 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27622025-01-28T23:17:22.185ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-28T23:17:22.185950434Z } propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27632025-01-28T23:17:22.190ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-28T23:17:22.185950434Z }, migration_in: None, migration_out: None }
27642025-01-28T23:17:22.258ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-28T23:17:22.258166880Z } file = sled-agent/src/instance.rs:781 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27652025-01-28T23:17:22.258ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-28T23:17:22.258166880Z } propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
27662025-01-28T23:17:22.258ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-28T23:17:22.258166880Z }, migration_in: None, migration_out: None }
27672025-01-28T23:17:22.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43272 req_id = 39b04fad-400a-42de-bb03-878c494a66a5 response_code = 204 uri = /vpc-routes
27682025-01-28T23:17:23.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38466
27692025-01-28T23:17:23.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38466 req_id = 3a3d1954-4651-4bac-a137-a3ff78c94baa response_code = 200 uri = /vpc-routes
27702025-01-28T23:17:23.336ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {46b648db-978e-4e54-9504-aff6f08e6f3c: {10.151.1.175: {f1560151-7b77-44db-bed6-3f4292b6ac8e}, 10.151.1.176: {f1560151-7b77-44db-bed6-3f4292b6ac8e}}} }
27712025-01-28T23:17:23.336ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38466 req_id = 78ff7229-755b-45e7-ae96-440ece69b100 response_code = 204 uri = /eip-gateways
27722025-01-28T23:17:23.395ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48816
27732025-01-28T23:17:23.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48816 req_id = 1b21ce34-8792-4fc7-aed9-bb5403144e4b response_code = 200 uri = /vmms/6d93c889-9f0f-48bb-b91c-51843863ff6b/state
27742025-01-28T23:17:23.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36706
27752025-01-28T23:17:23.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36706 req_id = bddc21eb-6d3c-4484-89c6-46753f7daf75 response_code = 200 uri = /v2p
27762025-01-28T23:17:23.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38466 req_id = 2d0df450-2e79-4a5c-bcb2-2138bb0e21ec response_code = 204 uri = /vpc-routes
27772025-01-28T23:17:23.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63054
27782025-01-28T23:17:23.538ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27792025-01-28T23:17:23.579ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27802025-01-28T23:17:23.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128575 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63054 req_id = 4cf12693-327b-4a05-84a3-36beec7bd32f response_code = 204 uri = /switch-ports
27812025-01-28T23:17:23.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63054 req_id = 54c3fe5b-63c7-4f6f-b21d-174d8e51aaee response_code = 200 uri = /network-bootstore-config
27822025-01-28T23:17:23.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38112
27832025-01-28T23:17:23.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38112 req_id = c4bfbbfa-0e51-43df-be30-f1f9338ca2c6 response_code = 200 uri = /vpc-routes
27842025-01-28T23:17:23.739ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37578
27852025-01-28T23:17:23.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37578 req_id = 494fdb28-07fe-434c-be94-f056565e8a63 response_code = 200 uri = /vmms/6d93c889-9f0f-48bb-b91c-51843863ff6b/state
27862025-01-28T23:17:23.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {46b648db-978e-4e54-9504-aff6f08e6f3c: {10.151.1.175: {f1560151-7b77-44db-bed6-3f4292b6ac8e}, 10.151.1.176: {f1560151-7b77-44db-bed6-3f4292b6ac8e}}} }
27872025-01-28T23:17:23.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38112 req_id = 8ff8cad3-bcdc-4f1d-9131-2084fda4a76f response_code = 204 uri = /eip-gateways
27882025-01-28T23:17:23.834ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64137
27892025-01-28T23:17:23.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64137 req_id = edf4b03a-ad23-4b7a-badf-87d309938b31 response_code = 200 uri = /vpc-routes
27902025-01-28T23:17:23.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54148
27912025-01-28T23:17:23.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54148 req_id = bc19e983-438e-4a1c-b394-5c0bfab25725 response_code = 200 uri = /vmms/6d93c889-9f0f-48bb-b91c-51843863ff6b/state
27922025-01-28T23:17:23.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47614
27932025-01-28T23:17:23.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47614 req_id = 649f2fd4-6868-4483-be3d-ca8735e40a73 response_code = 200 uri = /v2p
27942025-01-28T23:17:23.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60048
27952025-01-28T23:17:23.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60048 req_id = 5acf2b28-25b7-4966-a657-58e870452e14 response_code = 200 uri = /v2p
27962025-01-28T23:17:23.878ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {46b648db-978e-4e54-9504-aff6f08e6f3c: {10.151.1.176: {f1560151-7b77-44db-bed6-3f4292b6ac8e}, 10.151.1.175: {f1560151-7b77-44db-bed6-3f4292b6ac8e}}} }
27972025-01-28T23:17:23.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64137 req_id = b6dac905-6ec4-4344-9170-fd99a66dcf24 response_code = 204 uri = /eip-gateways
27982025-01-28T23:17:23.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38112 req_id = fe18bd2a-9a9b-42a8-a433-eabd7949af69 response_code = 204 uri = /vpc-routes
27992025-01-28T23:17:23.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64137 req_id = 4f589152-4a2f-4d4d-bba6-5ee22d8afa0f response_code = 204 uri = /vpc-routes
28002025-01-28T23:17:23.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58335
28012025-01-28T23:17:23.915ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28022025-01-28T23:17:23.953ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28032025-01-28T23:17:24.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58335 req_id = 1e805ed8-7e6c-44e2-9ce0-4c09316e52b9 response_code = 204 uri = /switch-ports
28042025-01-28T23:17:24.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50161
28052025-01-28T23:17:24.013ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28062025-01-28T23:17:24.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58335 req_id = 22f9151a-86fe-488f-9655-0826c4048ec9 response_code = 200 uri = /network-bootstore-config
28072025-01-28T23:17:24.053ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28082025-01-28T23:17:24.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98177 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50161 req_id = 9c2a811e-8101-4c92-98ec-de8556f44fab response_code = 204 uri = /switch-ports
28092025-01-28T23:17:24.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50161 req_id = 0cd60ed0-c271-4e4d-9b47-2fbfd5a37749 response_code = 200 uri = /network-bootstore-config
28102025-01-28T23:17:34.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47230
28112025-01-28T23:17:34.601ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 471 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47230 req_id = e5db414f-469b-41c5-bd9c-24af6ca56ee3 response_code = 200 uri = /vmms/6d93c889-9f0f-48bb-b91c-51843863ff6b/state
28122025-01-28T23:17:34.601ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-28T23:17:34.601703260Z } file = sled-agent/src/instance.rs:781 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
28132025-01-28T23:17:34.601ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-28T23:17:34.601703260Z } propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
28142025-01-28T23:17:34.601ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-28T23:17:34.601703260Z }, migration_in: None, migration_out: None }
28152025-01-28T23:17:34.629ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-28T23:17:34.629276610Z } file = sled-agent/src/instance.rs:781 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
28162025-01-28T23:17:34.629ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-28T23:17:34.629276610Z } propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
28172025-01-28T23:17:34.629ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
28182025-01-28T23:17:34.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28192025-01-28T23:17:34.629ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 5504925348746857606 n_samples = 6 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
28202025-01-28T23:17:34.629ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14924857562557591368 n_samples = 6 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
28212025-01-28T23:17:34.629ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28222025-01-28T23:17:34.629ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/14e0b5aa-661f-4c33-a465-6bdb69d0de3c/debug/bundle/zone", "/pool/int/500578dd-aed8-4d17-9960-3dae0d997cc1/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/68044c5c-97c7-414c-b44a-b8251f523a8f/crypt/debug", "/pool/ext/099773d5-5f69-4f65-8f86-75c48d557e90/crypt/debug", "/pool/ext/9c52c0b7-bd6c-4bc6-bf57-d79ee816fb68/crypt/debug", "/pool/ext/fd3ed43b-5bed-4fe3-a4dd-62484ebaeb19/crypt/debug", "/pool/ext/21294dfd-a58f-42c6-a41c-8b148c95a198/crypt/debug", "/pool/ext/ff6949fe-2851-437a-b6e9-cb91f2325920/crypt/debug", "/pool/ext/46e85043-614f-4a55-8660-1ccd892d22b2/crypt/debug", "/pool/ext/b6f4a7de-ae5d-4497-bee3-21826d504667/crypt/debug", "/pool/ext/79dc877f-201a-4a6a-a185-dc64a57ed603/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b
28232025-01-28T23:17:35.274ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b", bundle_id: a3a1ea87-be98-40eb-8c70-f78f3ce2f0ca }, time_created: 2025-01-28T23:17:34.637016799Z, version: 0, cause: TerminatedInstance }
28242025-01-28T23:17:35.274ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_6d93c889-9f0f-48bb-b91c-51843863ff6b file = sled-agent/src/instance.rs:1314 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
28252025-01-28T23:17:35.635ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7198 local_addr = [fd00:1122:3344:101::1]:42102 method = GET remote_addr = [fd00:1122:3344:101::d]:49049 req_id = 9a9c4528-3e82-4817-9b94-9f5f952dd4a4 response_code = 200 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc uri = /333ba0f0-e056-439e-a4d5-a88dac7ac1cc
28262025-01-28T23:17:37.042ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
28272025-01-28T23:17:37.058ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(11583525), kind: System }
28282025-01-28T23:17:37.058ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(11583525), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28292025-01-28T23:17:37.059ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-28T23:17:37.059123943Z }, migration_in: None, migration_out: None }
28302025-01-28T23:17:37.094ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-28T23:17:37.059123943Z }, migration_in: None, migration_out: None }
28312025-01-28T23:17:37.097ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = 75b683a3-c3ae-4f48-aa2b-c25298d1cdd6 propolis_id = 6d93c889-9f0f-48bb-b91c-51843863ff6b
28322025-01-28T23:17:37.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46196
28332025-01-28T23:17:37.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46196 req_id = 02aee726-ebed-4844-bb5a-38e9897ec8e9 response_code = 200 uri = /vpc-routes
28342025-01-28T23:17:37.642ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40559
28352025-01-28T23:17:37.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40559 req_id = 3ff4582d-03aa-44b2-a42c-f963fcaafb97 response_code = 200 uri = /v2p
28362025-01-28T23:17:37.652ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {46b648db-978e-4e54-9504-aff6f08e6f3c: {10.151.1.175: {f1560151-7b77-44db-bed6-3f4292b6ac8e}, 10.151.1.176: {f1560151-7b77-44db-bed6-3f4292b6ac8e}}} }
28372025-01-28T23:17:37.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46196 req_id = 5115eaea-5f50-4bbf-a68a-0e29b48a9d5d response_code = 204 uri = /eip-gateways
28382025-01-28T23:17:37.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46196 req_id = 84766ca1-e8fd-4e34-98c2-6e7ae06fa72d response_code = 204 uri = /vpc-routes
28392025-01-28T23:17:37.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49757
28402025-01-28T23:17:37.915ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49757 req_id = 1031ddff-0710-49cf-92af-45d17c27ef25 response_code = 200 uri = /v2p
28412025-01-28T23:17:37.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53684
28422025-01-28T23:17:37.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53684 req_id = 0d9d9c87-7f56-435e-bf47-96c217ac2cf0 response_code = 200 uri = /vpc-routes
28432025-01-28T23:17:37.935ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
28442025-01-28T23:17:37.935ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc
28452025-01-28T23:17:37.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53684 req_id = 14c6d812-773f-4233-beda-23db7945eeac response_code = 204 uri = /eip-gateways
28462025-01-28T23:17:37.943ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53684 req_id = 21d6dd8f-d56b-4855-8715-305c4ce14691 response_code = 204 uri = /vpc-routes
28472025-01-28T23:17:38.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40623
28482025-01-28T23:17:38.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40623 req_id = cf302817-8c95-4789-b060-dd85e7d18e7f response_code = 200 uri = /vpc-routes
28492025-01-28T23:17:38.759ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 333ba0f0-e056-439e-a4d5-a88dac7ac1cc values = ExternalIpGatewayMap { mappings: {} }
28502025-01-28T23:17:38.759ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40623 req_id = 71f399fd-e8fa-45c2-8842-57b28b5d4223 response_code = 204 uri = /eip-gateways
28512025-01-28T23:17:38.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40623 req_id = 87396afe-e1b1-4563-b9e5-5f9ae393c34c response_code = 204 uri = /vpc-routes