Max level shown:
1 [ Jan 17 07:58:24 Enabled. ]
2 [ Jan 17 07:58:24 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 17 07:58:24 Method "start" exited with status 0. ]
4 [ Jan 17 07:58:24 Rereading configuration. ]
5 [ Jan 17 07:58:24 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-17T07:58:24.032ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-17T07:58:24.032ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-17T07:58:24.087ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-17T07:58:24.087ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-17T07:58:24.203ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-17T07:58:24.211ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-17T07:58:24.220ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-17T07:58:24.823ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-01-17T07:58:24.963ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-17T07:58:24.963ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-17T07:58:24.963ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-17T07:58:24.963ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-17T07:58:24.963ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-01-17T07:58:24.963ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-01-17T07:58:24.966ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-17T07:58:24.966ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-17T07:58:24.966ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-17T07:58:24.966ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-17T07:58:24.966ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-17T07:58:24.966ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-17T07:58:24.966ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-17T07:58:24.966ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-17T07:58:24.966ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-17T07:58:24.978ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-17T07:58:24.978ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool)
322025-01-17T07:58:25.111ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal }
332025-01-17T07:58:25.609ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-17T07:58:25.609ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-17T07:58:25.609ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-17T07:58:25.610ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-17T07:58:25.610ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-17T07:58:25.610ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-17T07:58:25.610ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-17T07:58:25.618ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-17T07:58:25.619ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool)
422025-01-17T07:58:25.730ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal }
432025-01-17T07:58:26.223ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-17T07:58:26.223ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-17T07:58:26.223ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-17T07:58:26.223ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-17T07:58:26.223ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-17T07:58:26.223ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-17T07:58:26.223ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
532025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542025-01-17T07:58:26.223ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-17T07:58:26.223ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-17T07:58:26.223ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-17T07:58:26.223ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-17T07:58:26.223ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-17T07:58:26.223ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-17T07:58:26.223ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
642025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
652025-01-17T07:58:26.223ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
662025-01-17T07:58:26.223ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
672025-01-17T07:58:26.223ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-17T07:58:26.223ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-17T07:58:26.223ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-17T07:58:26.223ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
722025-01-17T07:58:26.223ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-17T07:58:26.223ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-17T07:58:26.223ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-17T07:58:26.224ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-17T07:58:26.224ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-17T07:58:26.224ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-17T07:58:26.224ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-17T07:58:26.224ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-17T07:58:26.224ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-17T07:58:26.224ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-17T07:58:26.224ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872025-01-17T07:58:26.224ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
882025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
892025-01-17T07:58:26.224ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
902025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-17T07:58:26.224ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-17T07:58:26.224ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
932025-01-17T07:58:26.224ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
942025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
952025-01-17T07:58:26.224ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
962025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-17T07:58:26.224ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-17T07:58:26.224ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
992025-01-17T07:58:26.224ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
1002025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-01-17T07:58:26.224ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-01-17T07:58:26.224ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-17T07:58:26.224ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-17T07:58:26.224ZINFOSledAgent (bootstore): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-01-17T07:58:26.224ZINFOSledAgent (bootstore): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-01-17T07:58:26.224ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-01-17T07:58:26.224ZINFOSledAgent (bootstore): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-01-17T07:58:26.224ZINFOSledAgent (bootstore): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-01-17T07:58:26.224ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-01-17T07:58:26.224ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-17T07:58:26.224ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-17T07:58:26.235ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-17T07:58:26.235ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1425, tv_nsec: 991982201 } time_to_next_cleanup = 599.999929369s
1142025-01-17T07:58:26.235ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-17T07:58:26.235ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-17T07:58:26.237ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-17T07:58:26.237ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-17T07:58:26.238ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-01-17T07:58:26.239ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-01-17T07:58:26.240ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-17T07:58:26.240ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-17T07:58:26.240ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-17T07:58:26.240ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-17T07:58:26.240ZINFOSledAgent (RSS): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-17T07:58:26.240ZINFOSledAgent (RSS): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-17T07:58:26.240ZINFOSledAgent (RSS): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-17T07:58:26.240ZINFOSledAgent (RSS): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-17T07:58:26.240ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-17T07:58:26.240ZINFOSledAgent (RSS): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-17T07:58:26.240ZINFOSledAgent (RSS): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-17T07:58:26.240ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-17T07:58:26.240ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-17T07:58:26.240ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-17T07:58:26.240ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-17T07:58:26.240ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-01-17T07:58:26.241ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-01-17T07:58:26.241ZINFOSledAgent (bootstore): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-01-17T07:58:26.241ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-01-17T07:58:26.241ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: d7936c62-666e-4e9a-9d0d-121ba64013ad (sled), rack_id: 45b632ae-1604-4734-a925-33119227b8d8, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-01-17T07:58:26.241ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-17T07:58:26.242ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-17T07:58:26.246ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-17T07:58:26.252ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-17T07:58:26.252ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-17T07:58:26.258ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-17T07:58:26.258ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-17T07:58:26.259ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:62019
1482025-01-17T07:58:26.259ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: d7936c62-666e-4e9a-9d0d-121ba64013ad (sled), rack_id: 45b632ae-1604-4734-a925-33119227b8d8, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-17T07:58:26.259ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-17T07:58:26.259ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-17T07:58:26.259ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-17T07:58:26.259ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-17T07:58:26.259ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-17T07:58:26.259ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-17T07:58:26.259ZINFOSledAgent (StorageManager): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-17T07:58:26.259ZINFOSledAgent (StorageManager): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-17T07:58:26.259ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-17T07:58:26.259ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-17T07:58:26.259ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-17T07:58:26.259ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-17T07:58:26.259ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-17T07:58:26.270ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-17T07:58:26.288ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-17T07:58:26.305ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-17T07:58:26.316ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
1662025-01-17T07:58:26.316ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-17T07:58:26.316ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
1682025-01-17T07:58:26.316ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-17T07:58:26.319ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 60.145492ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "04dccf22-55f0-4a41-8ebe-7eb48733254e", "content-length": "124", "date": "Fri, 17 Jan 2025 07:58:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "04dccf22-55f0-4a41-8ebe-7eb48733254e" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-17T07:58:26.330ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_fe1f35c4-7f25-4d50-ace9-b812bb03baba/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-17T07:58:26.359ZINFOSledAgent: successfully created encrypted zvol: name="oxi_fe1f35c4-7f25-4d50-ace9-b812bb03baba/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-17T07:58:26.359ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_fe1f35c4-7f25-4d50-ace9-b812bb03baba/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-17T07:58:26.365ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
1742025-01-17T07:58:26.365ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-17T07:58:26.365ZINFOSledAgent (BackingFs): Ensuring dataset oxi_fe1f35c4-7f25-4d50-ace9-b812bb03baba/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-17T07:58:26.381ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-17T07:58:26.381ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 162.008688ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "02d7c553-1366-4c34-a4fb-25435fa9d3d3", "content-length": "124", "date": "Fri, 17 Jan 2025 07:58:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "02d7c553-1366-4c34-a4fb-25435fa9d3d3" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-17T07:58:26.456ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-17T07:58:26.544ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-17T07:58:26.545ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 162.030123ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8343d148-6b4a-431d-ae93-091b3439fdc6", "content-length": "124", "date": "Fri, 17 Jan 2025 07:58:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8343d148-6b4a-431d-ae93-091b3439fdc6" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-17T07:58:26.674ZINFOSledAgent (BackingFs): Mounting oxi_fe1f35c4-7f25-4d50-ace9-b812bb03baba/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-17T07:58:26.687ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-17T07:58:26.688ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-17T07:58:26.688ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-17T07:58:26.688ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-17T07:58:26.708ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-17T07:58:26.708ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 242.237016ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "897ded42-9e4c-4560-b81e-b21f6cf7a006", "content-length": "124", "date": "Fri, 17 Jan 2025 07:58:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "897ded42-9e4c-4560-b81e-b21f6cf7a006" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-17T07:58:26.952ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-17T07:58:26.953ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 167.709824ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9defe80a-11ac-411b-a218-c0ce7c50798e", "content-length": "124", "date": "Fri, 17 Jan 2025 07:58:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9defe80a-11ac-411b-a218-c0ce7c50798e" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-17T07:58:27.122ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-17T07:58:27.123ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 259.493808ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c390425b-60df-48e2-8dc4-48f99d4b1aad", "content-length": "124", "date": "Fri, 17 Jan 2025 07:58:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c390425b-60df-48e2-8dc4-48f99d4b1aad" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-17T07:58:27.383ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-17T07:58:27.384ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 442.694791ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fadcfa75-1aa7-4704-b4f3-d50fa18bccc4", "content-length": "124", "date": "Fri, 17 Jan 2025 07:58:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fadcfa75-1aa7-4704-b4f3-d50fa18bccc4" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-17T07:58:27.444ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
1952025-01-17T07:58:27.450ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:48080 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
1962025-01-17T07:58:27.450ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
1972025-01-17T07:58:27.450ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:48080 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = d7936c62-666e-4e9a-9d0d-121ba64013ad sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
1982025-01-17T07:58:27.451ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 211.02333ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
1992025-01-17T07:58:27.452ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2002025-01-17T07:58:27.452ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2012025-01-17T07:58:27.452ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2022025-01-17T07:58:27.452ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-17T07:58:27.663ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 707.147129ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2042025-01-17T07:58:27.827ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2052025-01-17T07:58:28.372ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.020955422s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2062025-01-17T07:58:29.394ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.010408937s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2072025-01-17T07:58:30.019ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2082025-01-17T07:58:30.019ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2092025-01-17T07:58:30.019ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2102025-01-17T07:58:30.019ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2112025-01-17T07:58:30.019ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2122025-01-17T07:58:30.019ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2132025-01-17T07:58:30.021ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2142025-01-17T07:58:30.022ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2152025-01-17T07:58:30.022ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='84e9a10c-5ca2-447a-9ce2-806d3b7d48a6'/> <propval type="astring" name="rack_id" value='45b632ae-1604-4734-a925-33119227b8d8'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe3b:cc5'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='45b632ae-1604-4734-a925-33119227b8d8'/> <propval type="astring" name="sled_id" value='d7936c62-666e-4e9a-9d0d-121ba64013ad'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='d7936c62-666e-4e9a-9d0d-121ba64013ad'/> <propval type="astring" name="rack_uuid" value='45b632ae-1604-4734-a925-33119227b8d8'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='d7936c62-666e-4e9a-9d0d-121ba64013ad'/> <propval type="astring" name="rack_uuid" value='45b632ae-1604-4734-a925-33119227b8d8'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-17T07:58:30.022ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-17T07:58:30.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 58.594849ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-17T07:58:30.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 109.09207ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-17T07:58:30.525ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.012204396s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2202025-01-17T07:58:30.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 236.719397ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-17T07:58:31.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 221.72039ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-17T07:58:31.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 831.262045ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-01-17T07:58:32.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.174316455s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2242025-01-17T07:58:32.540ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.643095899s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2252025-01-17T07:58:33.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.000941796s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2262025-01-17T07:58:35.066ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 771.697461ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2272025-01-17T07:58:36.308ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/nexus.rs:527 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2282025-01-17T07:58:36.339ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292025-01-17T07:58:36.340ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2302025-01-17T07:58:36.341ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2312025-01-17T07:58:36.341ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322025-01-17T07:58:36.341ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2332025-01-17T07:58:36.341ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-17T07:58:36.341ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-01-17T07:58:36.341ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362025-01-17T07:58:36.342ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372025-01-17T07:58:36.342ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2382025-01-17T07:58:36.342ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:62019
2392025-01-17T07:58:36.547ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2402025-01-17T07:58:36.547ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2412025-01-17T07:58:36.552ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422025-01-17T07:58:36.552ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2432025-01-17T07:58:36.552ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442025-01-17T07:58:36.809ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48200
2452025-01-17T07:58:36.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-01-17T07:58:36.810ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2472025-01-17T07:58:36.810ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-01-17T07:58:36.810ZINFOSledAgent (ServiceManager): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:188
2492025-01-17T07:58:36.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48200 req_id = 795269d3-6be7-4caf-998f-63c578292d7d response_code = 200 uri = /inventory
2502025-01-17T07:58:36.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52832
2512025-01-17T07:58:36.841ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52832 req_id = 2effe1ca-627e-4228-9434-4a9cd86db75e response_code = 200 uri = /sled-role
2522025-01-17T07:58:36.873ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 01888607-93ee-433c-999c-8b7141c230ee (physical_disk), pool_id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 0a384dc4-49f7-4f74-ac57-3566227d8f7c (physical_disk), pool_id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 3a15a3e1-3b95-47af-a757-8dda522451d5 (physical_disk), pool_id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4687f2d5-d91a-4b60-8a86-dadc01c0341e (physical_disk), pool_id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 769e83e6-e091-4672-bc89-9d88d01a059c (physical_disk), pool_id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7ccdc2a8-a118-4c5d-8d3a-3a026814a17c (physical_disk), pool_id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 8ee73ee3-fb76-4722-bdc8-b3d9657ac04c (physical_disk), pool_id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b157c62a-66a5-4461-85e6-20b9bd850afb (physical_disk), pool_id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: da681b4f-cafd-4200-9339-d80b0c16051d (physical_disk), pool_id: 03539269-b412-4961-92af-cf162b13a30f (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532025-01-17T07:58:36.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44739
2542025-01-17T07:58:36.874ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2552025-01-17T07:58:36.874ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 01888607-93ee-433c-999c-8b7141c230ee (physical_disk), pool_id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 0a384dc4-49f7-4f74-ac57-3566227d8f7c (physical_disk), pool_id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 3a15a3e1-3b95-47af-a757-8dda522451d5 (physical_disk), pool_id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 4687f2d5-d91a-4b60-8a86-dadc01c0341e (physical_disk), pool_id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 769e83e6-e091-4672-bc89-9d88d01a059c (physical_disk), pool_id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 7ccdc2a8-a118-4c5d-8d3a-3a026814a17c (physical_disk), pool_id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 8ee73ee3-fb76-4722-bdc8-b3d9657ac04c (physical_disk), pool_id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: b157c62a-66a5-4461-85e6-20b9bd850afb (physical_disk), pool_id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: da681b4f-cafd-4200-9339-d80b0c16051d (physical_disk), pool_id: 03539269-b412-4961-92af-cf162b13a30f (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2562025-01-17T07:58:36.874ZINFOSledAgent (StorageManager): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572025-01-17T07:58:36.874ZINFOSledAgent (StorageManager): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582025-01-17T07:58:36.874ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2592025-01-17T07:58:36.874ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602025-01-17T07:58:36.874ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612025-01-17T07:58:36.874ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622025-01-17T07:58:36.874ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632025-01-17T07:58:37.022ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642025-01-17T07:58:37.022ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9813f791-8da3-471c-9021-42fd85d77240 (zpool)
2652025-01-17T07:58:37.253ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 13.206577268s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2662025-01-17T07:58:37.464ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2672025-01-17T07:58:37.466ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2682025-01-17T07:58:37.466ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10255916408389122773 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2692025-01-17T07:58:37.466ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 302010842147663326 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
2702025-01-17T07:58:37.543ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }
2712025-01-17T07:58:37.550ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2722025-01-17T07:58:37.550ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2732025-01-17T07:58:37.550ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2742025-01-17T07:58:37.550ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2752025-01-17T07:58:37.550ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762025-01-17T07:58:37.550ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772025-01-17T07:58:37.550ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2782025-01-17T07:58:37.597ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2792025-01-17T07:58:37.605ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/zone file = sled-storage/src/dataset.rs:302
2802025-01-17T07:58:37.787ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9813f791-8da3-471c-9021-42fd85d77240 file = sled-storage/src/dataset.rs:388
2812025-01-17T07:58:37.795ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2822025-01-17T07:58:37.795ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2832025-01-17T07:58:37.795ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2842025-01-17T07:58:37.795ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2852025-01-17T07:58:37.795ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2862025-01-17T07:58:37.805ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2872025-01-17T07:58:37.805ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 03539269-b412-4961-92af-cf162b13a30f (zpool)
2882025-01-17T07:58:37.927ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }
2892025-01-17T07:58:37.935ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2902025-01-17T07:58:37.935ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2912025-01-17T07:58:37.935ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2922025-01-17T07:58:37.935ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2932025-01-17T07:58:37.935ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2942025-01-17T07:58:37.935ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952025-01-17T07:58:37.935ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2962025-01-17T07:58:37.979ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2972025-01-17T07:58:37.987ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_03539269-b412-4961-92af-cf162b13a30f/crypt/zone file = sled-storage/src/dataset.rs:302
2982025-01-17T07:58:38.178ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_03539269-b412-4961-92af-cf162b13a30f file = sled-storage/src/dataset.rs:388
2992025-01-17T07:58:38.187ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3002025-01-17T07:58:38.187ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3012025-01-17T07:58:38.187ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3022025-01-17T07:58:38.187ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3032025-01-17T07:58:38.187ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3042025-01-17T07:58:38.197ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3052025-01-17T07:58:38.197ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool)
3062025-01-17T07:58:38.320ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }
3072025-01-17T07:58:38.328ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3082025-01-17T07:58:38.328ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3092025-01-17T07:58:38.328ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3102025-01-17T07:58:38.328ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3112025-01-17T07:58:38.328ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3122025-01-17T07:58:38.328ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132025-01-17T07:58:38.328ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3142025-01-17T07:58:38.372ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3152025-01-17T07:58:38.379ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone file = sled-storage/src/dataset.rs:302
3162025-01-17T07:58:38.469ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
3172025-01-17T07:58:38.562ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 file = sled-storage/src/dataset.rs:388
3182025-01-17T07:58:38.571ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3192025-01-17T07:58:38.571ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3202025-01-17T07:58:38.571ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3212025-01-17T07:58:38.571ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3222025-01-17T07:58:38.571ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232025-01-17T07:58:38.580ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3242025-01-17T07:58:38.580ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool)
3252025-01-17T07:58:38.702ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }
3262025-01-17T07:58:38.710ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3272025-01-17T07:58:38.710ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3282025-01-17T07:58:38.710ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3292025-01-17T07:58:38.710ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3302025-01-17T07:58:38.710ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312025-01-17T07:58:38.710ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322025-01-17T07:58:38.710ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3332025-01-17T07:58:38.759ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3342025-01-17T07:58:38.767ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone file = sled-storage/src/dataset.rs:302
3352025-01-17T07:58:38.955ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5 file = sled-storage/src/dataset.rs:388
3362025-01-17T07:58:38.963ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3372025-01-17T07:58:38.963ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3382025-01-17T07:58:38.963ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3392025-01-17T07:58:38.963ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3402025-01-17T07:58:38.963ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3412025-01-17T07:58:38.973ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3422025-01-17T07:58:38.973ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool)
3432025-01-17T07:58:39.098ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }
3442025-01-17T07:58:39.106ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3452025-01-17T07:58:39.106ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3462025-01-17T07:58:39.106ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3472025-01-17T07:58:39.106ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3482025-01-17T07:58:39.106ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3492025-01-17T07:58:39.106ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502025-01-17T07:58:39.106ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3512025-01-17T07:58:39.152ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3522025-01-17T07:58:39.160ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone file = sled-storage/src/dataset.rs:302
3532025-01-17T07:58:39.350ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_11fc8969-6569-4e63-b863-6b5f04571d1f file = sled-storage/src/dataset.rs:388
3542025-01-17T07:58:39.358ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3552025-01-17T07:58:39.358ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3562025-01-17T07:58:39.358ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3572025-01-17T07:58:39.358ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3582025-01-17T07:58:39.358ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3592025-01-17T07:58:39.369ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3602025-01-17T07:58:39.369ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fb743880-ceb4-4309-9fe1-855954a7a059 (zpool)
3612025-01-17T07:58:39.491ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }
3622025-01-17T07:58:39.499ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3632025-01-17T07:58:39.499ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3642025-01-17T07:58:39.499ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3652025-01-17T07:58:39.499ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3662025-01-17T07:58:39.499ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3672025-01-17T07:58:39.499ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682025-01-17T07:58:39.499ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3692025-01-17T07:58:39.503ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
3702025-01-17T07:58:39.544ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3712025-01-17T07:58:39.552ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone file = sled-storage/src/dataset.rs:302
3722025-01-17T07:58:39.735ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fb743880-ceb4-4309-9fe1-855954a7a059 file = sled-storage/src/dataset.rs:388
3732025-01-17T07:58:39.743ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3742025-01-17T07:58:39.743ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3752025-01-17T07:58:39.743ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3762025-01-17T07:58:39.743ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3772025-01-17T07:58:39.743ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3782025-01-17T07:58:39.753ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3792025-01-17T07:58:39.753ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool)
3802025-01-17T07:58:39.876ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }
3812025-01-17T07:58:39.883ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3822025-01-17T07:58:39.883ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3832025-01-17T07:58:39.883ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3842025-01-17T07:58:39.883ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3852025-01-17T07:58:39.884ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3862025-01-17T07:58:39.884ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872025-01-17T07:58:39.884ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3882025-01-17T07:58:39.929ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3892025-01-17T07:58:39.938ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone file = sled-storage/src/dataset.rs:302
3902025-01-17T07:58:40.153ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_24cecd51-2313-4198-99e2-aa6943e55b03 file = sled-storage/src/dataset.rs:388
3912025-01-17T07:58:40.161ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3922025-01-17T07:58:40.161ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3932025-01-17T07:58:40.161ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3942025-01-17T07:58:40.161ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3952025-01-17T07:58:40.161ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3962025-01-17T07:58:40.171ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3972025-01-17T07:58:40.171ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool)
3982025-01-17T07:58:40.290ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }
3992025-01-17T07:58:40.298ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4002025-01-17T07:58:40.298ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4012025-01-17T07:58:40.298ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4022025-01-17T07:58:40.298ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4032025-01-17T07:58:40.298ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4042025-01-17T07:58:40.298ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052025-01-17T07:58:40.298ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4062025-01-17T07:58:40.341ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4072025-01-17T07:58:40.349ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone file = sled-storage/src/dataset.rs:302
4082025-01-17T07:58:40.506ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4092025-01-17T07:58:40.545ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf file = sled-storage/src/dataset.rs:388
4102025-01-17T07:58:40.553ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4112025-01-17T07:58:40.554ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4122025-01-17T07:58:40.554ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4132025-01-17T07:58:40.554ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4142025-01-17T07:58:40.554ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4152025-01-17T07:58:40.564ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4162025-01-17T07:58:40.564ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 22491af9-677c-492c-b09f-dd32d6d37612 (zpool)
4172025-01-17T07:58:40.693ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }
4182025-01-17T07:58:40.701ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4192025-01-17T07:58:40.701ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4202025-01-17T07:58:40.701ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4212025-01-17T07:58:40.701ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4222025-01-17T07:58:40.701ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232025-01-17T07:58:40.701ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242025-01-17T07:58:40.701ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4252025-01-17T07:58:40.747ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4262025-01-17T07:58:40.756ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone file = sled-storage/src/dataset.rs:302
4272025-01-17T07:58:40.951ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_22491af9-677c-492c-b09f-dd32d6d37612 file = sled-storage/src/dataset.rs:388
4282025-01-17T07:58:40.960ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4292025-01-17T07:58:40.960ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4302025-01-17T07:58:40.960ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-01-17T07:58:40.960ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe1f35c4-7f25-4d50-ace9-b812bb03baba (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 37794d2e-e14b-4ced-a139-272d5ed64db4 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4322025-01-17T07:58:40.960ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4332025-01-17T07:58:40.960ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4342025-01-17T07:58:40.960ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4352025-01-17T07:58:40.960ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4362025-01-17T07:58:40.960ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4372025-01-17T07:58:40.960ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4382025-01-17T07:58:40.960ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4392025-01-17T07:58:40.960ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4402025-01-17T07:58:40.960ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4412025-01-17T07:58:40.960ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4422025-01-17T07:58:40.960ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4432025-01-17T07:58:40.960ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4442025-01-17T07:58:40.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4086764 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44739 req_id = 26ac0bf2-fc08-4d6b-a0cb-c9f525da4aa1 response_code = 200 uri = /omicron-physical-disks
4452025-01-17T07:58:40.992ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {04d027a0-6c35-4b88-81d2-87a542c3635c (dataset): DatasetConfig { id: 04d027a0-6c35-4b88-81d2-87a542c3635c (dataset), name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06a856f7-5e82-46a3-9488-a33912f8bddf (dataset): DatasetConfig { id: 06a856f7-5e82-46a3-9488-a33912f8bddf (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0ef70042-1cd6-4a68-a125-7121b374eb4a (dataset): DatasetConfig { id: 0ef70042-1cd6-4a68-a125-7121b374eb4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 104e12e3-41b9-4193-8321-b3a5ed977a38 (dataset): DatasetConfig { id: 104e12e3-41b9-4193-8321-b3a5ed977a38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 127d49ec-524c-4861-93ee-eec843f0c511 (dataset): DatasetConfig { id: 127d49ec-524c-4861-93ee-eec843f0c511 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13724237-0e94-4ab1-b6cd-c729f7f6a6ef (dataset): DatasetConfig { id: 13724237-0e94-4ab1-b6cd-c729f7f6a6ef (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 158131d0-f764-487b-a622-3ecddc1e6167 (dataset): DatasetConfig { id: 158131d0-f764-487b-a622-3ecddc1e6167 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a35d82c-65c3-48f3-a047-1361b6c6e2a8 (dataset): DatasetConfig { id: 1a35d82c-65c3-48f3-a047-1361b6c6e2a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a35db06-3e14-442b-bcc7-22a3040ad903 (dataset): DatasetConfig { id: 1a35db06-3e14-442b-bcc7-22a3040ad903 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1aa49672-ce20-481c-8532-0be0943a1e92 (dataset): DatasetConfig { id: 1aa49672-ce20-481c-8532-0be0943a1e92 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1ae7abd6-d2dd-41a0-9730-54b4db5a64be (dataset): DatasetConfig { id: 1ae7abd6-d2dd-41a0-9730-54b4db5a64be (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 201a69cf-d484-4554-8f73-e21e65785e08 (dataset): DatasetConfig { id: 201a69cf-d484-4554-8f73-e21e65785e08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2598242d-8edb-49fb-ab67-130cd3f74c5e (dataset): DatasetConfig { id: 2598242d-8edb-49fb-ab67-130cd3f74c5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f134d99-88e8-4763-8975-d28335dfa322 (dataset): DatasetConfig { id: 2f134d99-88e8-4763-8975-d28335dfa322 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31844af0-dceb-4d01-8cff-d4c206fceacd (dataset): DatasetConfig { id: 31844af0-dceb-4d01-8cff-d4c206fceacd (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 343bcf15-6097-46e6-80d6-b21894f2300d (dataset): DatasetConfig { id: 343bcf15-6097-46e6-80d6-b21894f2300d (dataset), name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3458bb8e-4ee8-4646-81bd-0fd12a0bb5e7 (dataset): DatasetConfig { id: 3458bb8e-4ee8-4646-81bd-0fd12a0bb5e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4376a60e-789c-4070-8034-1cc64939dcd9 (dataset): DatasetConfig { id: 4376a60e-789c-4070-8034-1cc64939dcd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43f991c1-b9c2-4c8b-8252-0a5f82feb896 (dataset): DatasetConfig { id: 43f991c1-b9c2-4c8b-8252-0a5f82feb896 (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 446d514b-736c-4532-81d0-393f5b344633 (dataset): DatasetConfig { id: 446d514b-736c-4532-81d0-393f5b344633 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a2b80c7-66be-47fc-90f0-55933072369d (dataset): DatasetConfig { id: 4a2b80c7-66be-47fc-90f0-55933072369d (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e11a4d9-418b-45cd-98a7-4ba3ac8ace3a (dataset): DatasetConfig { id: 4e11a4d9-418b-45cd-98a7-4ba3ac8ace3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e6f4796-1f2e-470b-87e6-12107a087d7b (dataset): DatasetConfig { id: 4e6f4796-1f2e-470b-87e6-12107a087d7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5256c005-d5af-43bf-bfe3-f85a0b4288ac (dataset): DatasetConfig { id: 5256c005-d5af-43bf-bfe3-f85a0b4288ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 562f2de0-b7ce-4c9f-ab27-82ea28b5743a (dataset): DatasetConfig { id: 562f2de0-b7ce-4c9f-ab27-82ea28b5743a (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58c10d21-d9d5-460b-8047-f4db7d42e6cc (dataset): DatasetConfig { id: 58c10d21-d9d5-460b-8047-f4db7d42e6cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f693c6c-f236-4e85-b2ef-8e249062d4a1 (dataset): DatasetConfig { id: 5f693c6c-f236-4e85-b2ef-8e249062d4a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6265a0c3-eb93-4ada-9573-00b7847c2a06 (dataset): DatasetConfig { id: 6265a0c3-eb93-4ada-9573-00b7847c2a06 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63272576-4309-4f7c-aaaa-1e1a4fd63d88 (dataset): DatasetConfig { id: 63272576-4309-4f7c-aaaa-1e1a4fd63d88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71b773c5-d94e-4322-9191-2f83341dd0dd (dataset): DatasetConfig { id: 71b773c5-d94e-4322-9191-2f83341dd0dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76cefe11-23d7-488b-bfb1-c8db83f462ed (dataset): DatasetConfig { id: 76cefe11-23d7-488b-bfb1-c8db83f462ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77a9cab5-b0f9-4bc1-be03-55894dfc9f91 (dataset): DatasetConfig { id: 77a9cab5-b0f9-4bc1-be03-55894dfc9f91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c90dc82-b16f-4a71-86db-b24a1676a64a (dataset): DatasetConfig { id: 7c90dc82-b16f-4a71-86db-b24a1676a64a (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ff8fca8-dcfd-4745-a61c-2b1b55d785a6 (dataset): DatasetConfig { id: 7ff8fca8-dcfd-4745-a61c-2b1b55d785a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 85f3da08-0f89-4643-bf88-23640fc5ad3c (dataset): DatasetConfig { id: 85f3da08-0f89-4643-bf88-23640fc5ad3c (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86a9b4fe-37fe-4dd4-be97-ea7eeef86e45 (dataset): DatasetConfig { id: 86a9b4fe-37fe-4dd4-be97-ea7eeef86e45 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86fe53df-3a29-45d8-b9ee-84d24947bde5 (dataset): DatasetConfig { id: 86fe53df-3a29-45d8-b9ee-84d24947bde5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9195fc94-8534-4317-93f3-29356036e19d (dataset): DatasetConfig { id: 9195fc94-8534-4317-93f3-29356036e19d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91eaf7c3-198c-4d7c-ac7d-44579abbc124 (dataset): DatasetConfig { id: 91eaf7c3-198c-4d7c-ac7d-44579abbc124 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 91f2df17-75e6-40f0-87e5-72194c86c62a (dataset): DatasetConfig { id: 91f2df17-75e6-40f0-87e5-72194c86c62a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 951dbca1-4446-49f2-87ce-04d348f9eef0 (dataset): DatasetConfig { id: 951dbca1-4446-49f2-87ce-04d348f9eef0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9adca351-edee-408c-b804-eea1b828e37f (dataset): DatasetConfig { id: 9adca351-edee-408c-b804-eea1b828e37f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a34f1b37-9913-497b-97d9-83be1fc7b334 (dataset): DatasetConfig { id: a34f1b37-9913-497b-97d9-83be1fc7b334 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9a5d02f-b92f-4d44-b5fb-bc3af1612554 (dataset): DatasetConfig { id: a9a5d02f-b92f-4d44-b5fb-bc3af1612554 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aad2be1b-4110-43e1-9d15-b527039cc5bf (dataset): DatasetConfig { id: aad2be1b-4110-43e1-9d15-b527039cc5bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3f8d1dd-f23e-4ffd-be3e-4f572da27633 (dataset): DatasetConfig { id: b3f8d1dd-f23e-4ffd-be3e-4f572da27633 (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6766c96-9913-4ff5-9a19-4cc374aa9c59 (dataset): DatasetConfig { id: b6766c96-9913-4ff5-9a19-4cc374aa9c59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7a87c99-2b0a-45f5-a059-92cbe6cb8f87 (dataset): DatasetConfig { id: b7a87c99-2b0a-45f5-a059-92cbe6cb8f87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba2d7ba4-a50d-4144-a209-8692e89d1e04 (dataset): DatasetConfig { id: ba2d7ba4-a50d-4144-a209-8692e89d1e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb09646f-3d97-4fb6-b12d-b9c7019cf9b5 (dataset): DatasetConfig { id: bb09646f-3d97-4fb6-b12d-b9c7019cf9b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2b9d091-4fa6-41b2-80f2-c91ebb47aee2 (dataset): DatasetConfig { id: c2b9d091-4fa6-41b2-80f2-c91ebb47aee2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5cd5daf-8865-4636-bf11-46a881714f64 (dataset): DatasetConfig { id: c5cd5daf-8865-4636-bf11-46a881714f64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6e067bc-19b8-4cee-9151-e446dadb4753 (dataset): DatasetConfig { id: c6e067bc-19b8-4cee-9151-e446dadb4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7136e00-befa-47e2-9fe3-83f22b01bddb (dataset): DatasetConfig { id: c7136e00-befa-47e2-9fe3-83f22b01bddb (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d51be351-d1b5-49e8-b442-635742ee2384 (dataset): DatasetConfig { id: d51be351-d1b5-49e8-b442-635742ee2384 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d74fd5b9-1ff6-4ccf-973b-9dfb628ce438 (dataset): DatasetConfig { id: d74fd5b9-1ff6-4ccf-973b-9dfb628ce438 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d82756c3-6ddb-4495-90d4-97e8c4213d83 (dataset): DatasetConfig { id: d82756c3-6ddb-4495-90d4-97e8c4213d83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, de1e0acf-c74d-4986-b7c5-7c1887666d31 (dataset): DatasetConfig { id: de1e0acf-c74d-4986-b7c5-7c1887666d31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df8ebee8-7bc2-4be1-af9a-3dc79081e956 (dataset): DatasetConfig { id: df8ebee8-7bc2-4be1-af9a-3dc79081e956 (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6c8cc80-6c31-43d8-b46c-ef678d70ee3c (dataset): DatasetConfig { id: e6c8cc80-6c31-43d8-b46c-ef678d70ee3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7b5412e-a9ea-4f66-9740-d45ba70de0f7 (dataset): DatasetConfig { id: e7b5412e-a9ea-4f66-9740-d45ba70de0f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee8593ea-d9d2-476e-a19f-3ec14a277198 (dataset): DatasetConfig { id: ee8593ea-d9d2-476e-a19f-3ec14a277198 (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f15a77da-e718-4277-b7cb-1aafed0f94b1 (dataset): DatasetConfig { id: f15a77da-e718-4277-b7cb-1aafed0f94b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fab0e74b-5612-488c-9d37-2d74a74c02f7 (dataset): DatasetConfig { id: fab0e74b-5612-488c-9d37-2d74a74c02f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fae18b77-029a-4122-bcef-03af50c4394c (dataset): DatasetConfig { id: fae18b77-029a-4122-bcef-03af50c4394c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fc4aa6cd-1b3b-4a68-8d00-f0b58bb021c2 (dataset): DatasetConfig { id: fc4aa6cd-1b3b-4a68-8d00-f0b58bb021c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4462025-01-17T07:58:40.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50294
4472025-01-17T07:58:40.993ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4482025-01-17T07:58:40.993ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {04d027a0-6c35-4b88-81d2-87a542c3635c (dataset): DatasetConfig { id: 04d027a0-6c35-4b88-81d2-87a542c3635c (dataset), name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 06a856f7-5e82-46a3-9488-a33912f8bddf (dataset): DatasetConfig { id: 06a856f7-5e82-46a3-9488-a33912f8bddf (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 0ef70042-1cd6-4a68-a125-7121b374eb4a (dataset): DatasetConfig { id: 0ef70042-1cd6-4a68-a125-7121b374eb4a (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 104e12e3-41b9-4193-8321-b3a5ed977a38 (dataset): DatasetConfig { id: 104e12e3-41b9-4193-8321-b3a5ed977a38 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 127d49ec-524c-4861-93ee-eec843f0c511 (dataset): DatasetConfig { id: 127d49ec-524c-4861-93ee-eec843f0c511 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 13724237-0e94-4ab1-b6cd-c729f7f6a6ef (dataset): DatasetConfig { id: 13724237-0e94-4ab1-b6cd-c729f7f6a6ef (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 158131d0-f764-487b-a622-3ecddc1e6167 (dataset): DatasetConfig { id: 158131d0-f764-487b-a622-3ecddc1e6167 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a35d82c-65c3-48f3-a047-1361b6c6e2a8 (dataset): DatasetConfig { id: 1a35d82c-65c3-48f3-a047-1361b6c6e2a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a35db06-3e14-442b-bcc7-22a3040ad903 (dataset): DatasetConfig { id: 1a35db06-3e14-442b-bcc7-22a3040ad903 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1aa49672-ce20-481c-8532-0be0943a1e92 (dataset): DatasetConfig { id: 1aa49672-ce20-481c-8532-0be0943a1e92 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1ae7abd6-d2dd-41a0-9730-54b4db5a64be (dataset): DatasetConfig { id: 1ae7abd6-d2dd-41a0-9730-54b4db5a64be (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 201a69cf-d484-4554-8f73-e21e65785e08 (dataset): DatasetConfig { id: 201a69cf-d484-4554-8f73-e21e65785e08 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2598242d-8edb-49fb-ab67-130cd3f74c5e (dataset): DatasetConfig { id: 2598242d-8edb-49fb-ab67-130cd3f74c5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2f134d99-88e8-4763-8975-d28335dfa322 (dataset): DatasetConfig { id: 2f134d99-88e8-4763-8975-d28335dfa322 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 31844af0-dceb-4d01-8cff-d4c206fceacd (dataset): DatasetConfig { id: 31844af0-dceb-4d01-8cff-d4c206fceacd (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 343bcf15-6097-46e6-80d6-b21894f2300d (dataset): DatasetConfig { id: 343bcf15-6097-46e6-80d6-b21894f2300d (dataset), name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3458bb8e-4ee8-4646-81bd-0fd12a0bb5e7 (dataset): DatasetConfig { id: 3458bb8e-4ee8-4646-81bd-0fd12a0bb5e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4376a60e-789c-4070-8034-1cc64939dcd9 (dataset): DatasetConfig { id: 4376a60e-789c-4070-8034-1cc64939dcd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 43f991c1-b9c2-4c8b-8252-0a5f82feb896 (dataset): DatasetConfig { id: 43f991c1-b9c2-4c8b-8252-0a5f82feb896 (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 446d514b-736c-4532-81d0-393f5b344633 (dataset): DatasetConfig { id: 446d514b-736c-4532-81d0-393f5b344633 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4a2b80c7-66be-47fc-90f0-55933072369d (dataset): DatasetConfig { id: 4a2b80c7-66be-47fc-90f0-55933072369d (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e11a4d9-418b-45cd-98a7-4ba3ac8ace3a (dataset): DatasetConfig { id: 4e11a4d9-418b-45cd-98a7-4ba3ac8ace3a (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4e6f4796-1f2e-470b-87e6-12107a087d7b (dataset): DatasetConfig { id: 4e6f4796-1f2e-470b-87e6-12107a087d7b (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5256c005-d5af-43bf-bfe3-f85a0b4288ac (dataset): DatasetConfig { id: 5256c005-d5af-43bf-bfe3-f85a0b4288ac (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 562f2de0-b7ce-4c9f-ab27-82ea28b5743a (dataset): DatasetConfig { id: 562f2de0-b7ce-4c9f-ab27-82ea28b5743a (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 58c10d21-d9d5-460b-8047-f4db7d42e6cc (dataset): DatasetConfig { id: 58c10d21-d9d5-460b-8047-f4db7d42e6cc (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5f693c6c-f236-4e85-b2ef-8e249062d4a1 (dataset): DatasetConfig { id: 5f693c6c-f236-4e85-b2ef-8e249062d4a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6265a0c3-eb93-4ada-9573-00b7847c2a06 (dataset): DatasetConfig { id: 6265a0c3-eb93-4ada-9573-00b7847c2a06 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 63272576-4309-4f7c-aaaa-1e1a4fd63d88 (dataset): DatasetConfig { id: 63272576-4309-4f7c-aaaa-1e1a4fd63d88 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71b773c5-d94e-4322-9191-2f83341dd0dd (dataset): DatasetConfig { id: 71b773c5-d94e-4322-9191-2f83341dd0dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 76cefe11-23d7-488b-bfb1-c8db83f462ed (dataset): DatasetConfig { id: 76cefe11-23d7-488b-bfb1-c8db83f462ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 77a9cab5-b0f9-4bc1-be03-55894dfc9f91 (dataset): DatasetConfig { id: 77a9cab5-b0f9-4bc1-be03-55894dfc9f91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7c90dc82-b16f-4a71-86db-b24a1676a64a (dataset): DatasetConfig { id: 7c90dc82-b16f-4a71-86db-b24a1676a64a (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ff8fca8-dcfd-4745-a61c-2b1b55d785a6 (dataset): DatasetConfig { id: 7ff8fca8-dcfd-4745-a61c-2b1b55d785a6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 85f3da08-0f89-4643-bf88-23640fc5ad3c (dataset): DatasetConfig { id: 85f3da08-0f89-4643-bf88-23640fc5ad3c (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86a9b4fe-37fe-4dd4-be97-ea7eeef86e45 (dataset): DatasetConfig { id: 86a9b4fe-37fe-4dd4-be97-ea7eeef86e45 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 86fe53df-3a29-45d8-b9ee-84d24947bde5 (dataset): DatasetConfig { id: 86fe53df-3a29-45d8-b9ee-84d24947bde5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9195fc94-8534-4317-93f3-29356036e19d (dataset): DatasetConfig { id: 9195fc94-8534-4317-93f3-29356036e19d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 91eaf7c3-198c-4d7c-ac7d-44579abbc124 (dataset): DatasetConfig { id: 91eaf7c3-198c-4d7c-ac7d-44579abbc124 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 91f2df17-75e6-40f0-87e5-72194c86c62a (dataset): DatasetConfig { id: 91f2df17-75e6-40f0-87e5-72194c86c62a (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 951dbca1-4446-49f2-87ce-04d348f9eef0 (dataset): DatasetConfig { id: 951dbca1-4446-49f2-87ce-04d348f9eef0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9adca351-edee-408c-b804-eea1b828e37f (dataset): DatasetConfig { id: 9adca351-edee-408c-b804-eea1b828e37f (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a34f1b37-9913-497b-97d9-83be1fc7b334 (dataset): DatasetConfig { id: a34f1b37-9913-497b-97d9-83be1fc7b334 (dataset), name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a9a5d02f-b92f-4d44-b5fb-bc3af1612554 (dataset): DatasetConfig { id: a9a5d02f-b92f-4d44-b5fb-bc3af1612554 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aad2be1b-4110-43e1-9d15-b527039cc5bf (dataset): DatasetConfig { id: aad2be1b-4110-43e1-9d15-b527039cc5bf (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3f8d1dd-f23e-4ffd-be3e-4f572da27633 (dataset): DatasetConfig { id: b3f8d1dd-f23e-4ffd-be3e-4f572da27633 (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6766c96-9913-4ff5-9a19-4cc374aa9c59 (dataset): DatasetConfig { id: b6766c96-9913-4ff5-9a19-4cc374aa9c59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7a87c99-2b0a-45f5-a059-92cbe6cb8f87 (dataset): DatasetConfig { id: b7a87c99-2b0a-45f5-a059-92cbe6cb8f87 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ba2d7ba4-a50d-4144-a209-8692e89d1e04 (dataset): DatasetConfig { id: ba2d7ba4-a50d-4144-a209-8692e89d1e04 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb09646f-3d97-4fb6-b12d-b9c7019cf9b5 (dataset): DatasetConfig { id: bb09646f-3d97-4fb6-b12d-b9c7019cf9b5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c2b9d091-4fa6-41b2-80f2-c91ebb47aee2 (dataset): DatasetConfig { id: c2b9d091-4fa6-41b2-80f2-c91ebb47aee2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c5cd5daf-8865-4636-bf11-46a881714f64 (dataset): DatasetConfig { id: c5cd5daf-8865-4636-bf11-46a881714f64 (dataset), name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6e067bc-19b8-4cee-9151-e446dadb4753 (dataset): DatasetConfig { id: c6e067bc-19b8-4cee-9151-e446dadb4753 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7136e00-befa-47e2-9fe3-83f22b01bddb (dataset): DatasetConfig { id: c7136e00-befa-47e2-9fe3-83f22b01bddb (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d51be351-d1b5-49e8-b442-635742ee2384 (dataset): DatasetConfig { id: d51be351-d1b5-49e8-b442-635742ee2384 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d74fd5b9-1ff6-4ccf-973b-9dfb628ce438 (dataset): DatasetConfig { id: d74fd5b9-1ff6-4ccf-973b-9dfb628ce438 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d82756c3-6ddb-4495-90d4-97e8c4213d83 (dataset): DatasetConfig { id: d82756c3-6ddb-4495-90d4-97e8c4213d83 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, de1e0acf-c74d-4986-b7c5-7c1887666d31 (dataset): DatasetConfig { id: de1e0acf-c74d-4986-b7c5-7c1887666d31 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, df8ebee8-7bc2-4be1-af9a-3dc79081e956 (dataset): DatasetConfig { id: df8ebee8-7bc2-4be1-af9a-3dc79081e956 (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e6c8cc80-6c31-43d8-b46c-ef678d70ee3c (dataset): DatasetConfig { id: e6c8cc80-6c31-43d8-b46c-ef678d70ee3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e7b5412e-a9ea-4f66-9740-d45ba70de0f7 (dataset): DatasetConfig { id: e7b5412e-a9ea-4f66-9740-d45ba70de0f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee8593ea-d9d2-476e-a19f-3ec14a277198 (dataset): DatasetConfig { id: ee8593ea-d9d2-476e-a19f-3ec14a277198 (dataset), name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f15a77da-e718-4277-b7cb-1aafed0f94b1 (dataset): DatasetConfig { id: f15a77da-e718-4277-b7cb-1aafed0f94b1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fab0e74b-5612-488c-9d37-2d74a74c02f7 (dataset): DatasetConfig { id: fab0e74b-5612-488c-9d37-2d74a74c02f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fae18b77-029a-4122-bcef-03af50c4394c (dataset): DatasetConfig { id: fae18b77-029a-4122-bcef-03af50c4394c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, fc4aa6cd-1b3b-4a68-8d00-f0b58bb021c2 (dataset): DatasetConfig { id: fc4aa6cd-1b3b-4a68-8d00-f0b58bb021c2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4492025-01-17T07:58:40.993ZINFOSledAgent (StorageManager): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4502025-01-17T07:58:40.993ZINFOSledAgent (StorageManager): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512025-01-17T07:58:40.993ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4522025-01-17T07:58:41.009ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4532025-01-17T07:58:41.009ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4542025-01-17T07:58:41.009ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone"), full_name: "oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone" } file = sled-storage/src/manager.rs:1431
4552025-01-17T07:58:41.050ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4562025-01-17T07:58:41.050ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4572025-01-17T07:58:41.050ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/debug"), full_name: "oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/debug" } file = sled-storage/src/manager.rs:1431
4582025-01-17T07:58:41.091ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4592025-01-17T07:58:41.091ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4602025-01-17T07:58:41.091ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_24cecd51-2313-4198-99e2-aa6943e55b03/crucible" } file = sled-storage/src/manager.rs:1431
4612025-01-17T07:58:41.159ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4622025-01-17T07:58:41.159ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4632025-01-17T07:58:41.159ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d" } file = sled-storage/src/manager.rs:1431
4642025-01-17T07:58:41.246ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4652025-01-17T07:58:41.246ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4662025-01-17T07:58:41.246ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4672025-01-17T07:58:41.323ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4682025-01-17T07:58:41.323ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4692025-01-17T07:58:41.323ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), full_name: "oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2" } file = sled-storage/src/manager.rs:1431
4702025-01-17T07:58:41.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4712025-01-17T07:58:41.409ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4722025-01-17T07:58:41.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68" } file = sled-storage/src/manager.rs:1431
4732025-01-17T07:58:41.494ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4742025-01-17T07:58:41.494ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4752025-01-17T07:58:41.494ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone"), full_name: "oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone" } file = sled-storage/src/manager.rs:1431
4762025-01-17T07:58:41.508ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
4772025-01-17T07:58:41.536ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782025-01-17T07:58:41.536ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4792025-01-17T07:58:41.536ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/debug"), full_name: "oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/debug" } file = sled-storage/src/manager.rs:1431
4802025-01-17T07:58:41.579ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812025-01-17T07:58:41.579ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4822025-01-17T07:58:41.579ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/debug"), full_name: "oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crypt/debug" } file = sled-storage/src/manager.rs:1431
4832025-01-17T07:58:41.624ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842025-01-17T07:58:41.624ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852025-01-17T07:58:41.624ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7"), full_name: "oxp_24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7" } file = sled-storage/src/manager.rs:1431
4862025-01-17T07:58:41.704ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872025-01-17T07:58:41.704ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4882025-01-17T07:58:41.704ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52"), full_name: "oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52" } file = sled-storage/src/manager.rs:1431
4892025-01-17T07:58:41.786ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902025-01-17T07:58:41.786ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912025-01-17T07:58:41.786ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crucible" } file = sled-storage/src/manager.rs:1431
4922025-01-17T07:58:41.853ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-01-17T07:58:41.853ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4942025-01-17T07:58:41.853ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone"), full_name: "oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone" } file = sled-storage/src/manager.rs:1431
4952025-01-17T07:58:41.896ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-01-17T07:58:41.896ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972025-01-17T07:58:41.896ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4982025-01-17T07:58:41.965ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4992025-01-17T07:58:41.965ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5002025-01-17T07:58:41.965ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf/crucible" } file = sled-storage/src/manager.rs:1431
5012025-01-17T07:58:42.035ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5022025-01-17T07:58:42.035ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5032025-01-17T07:58:42.035ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5042025-01-17T07:58:42.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5052025-01-17T07:58:42.106ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5062025-01-17T07:58:42.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone"), full_name: "oxp_24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone" } file = sled-storage/src/manager.rs:1431
5072025-01-17T07:58:42.148ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5082025-01-17T07:58:42.148ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5092025-01-17T07:58:42.148ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone"), full_name: "oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone" } file = sled-storage/src/manager.rs:1431
5102025-01-17T07:58:42.189ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5112025-01-17T07:58:42.189ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5122025-01-17T07:58:42.189ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff"), full_name: "oxp_03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff" } file = sled-storage/src/manager.rs:1431
5132025-01-17T07:58:42.276ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5142025-01-17T07:58:42.276ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5152025-01-17T07:58:42.276ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_03539269-b412-4961-92af-cf162b13a30f/crucible" } file = sled-storage/src/manager.rs:1431
5162025-01-17T07:58:42.352ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5172025-01-17T07:58:42.352ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5182025-01-17T07:58:42.352ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/debug"), full_name: "oxp_03539269-b412-4961-92af-cf162b13a30f/crypt/debug" } file = sled-storage/src/manager.rs:1431
5192025-01-17T07:58:42.397ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5202025-01-17T07:58:42.397ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5212025-01-17T07:58:42.397ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crucible" } file = sled-storage/src/manager.rs:1431
5222025-01-17T07:58:42.476ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5232025-01-17T07:58:42.476ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5242025-01-17T07:58:42.476ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crucible" } file = sled-storage/src/manager.rs:1431
5252025-01-17T07:58:42.509ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
5262025-01-17T07:58:42.550ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272025-01-17T07:58:42.550ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5282025-01-17T07:58:42.550ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993"), full_name: "oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993" } file = sled-storage/src/manager.rs:1431
5292025-01-17T07:58:42.632ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302025-01-17T07:58:42.632ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312025-01-17T07:58:42.632ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5322025-01-17T07:58:42.709ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-01-17T07:58:42.709ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5342025-01-17T07:58:42.709ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410" } file = sled-storage/src/manager.rs:1431
5352025-01-17T07:58:42.795ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-01-17T07:58:42.795ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372025-01-17T07:58:42.795ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759"), full_name: "oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759" } file = sled-storage/src/manager.rs:1431
5382025-01-17T07:58:42.877ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-01-17T07:58:42.877ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402025-01-17T07:58:42.877ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b" } file = sled-storage/src/manager.rs:1431
5412025-01-17T07:58:42.959ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422025-01-17T07:58:42.959ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432025-01-17T07:58:42.959ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5442025-01-17T07:58:43.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-01-17T07:58:43.031ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462025-01-17T07:58:43.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b"), full_name: "oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b" } file = sled-storage/src/manager.rs:1431
5472025-01-17T07:58:43.112ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-01-17T07:58:43.112ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5492025-01-17T07:58:43.112ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3"), full_name: "oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3" } file = sled-storage/src/manager.rs:1431
5502025-01-17T07:58:43.196ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-01-17T07:58:43.196ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522025-01-17T07:58:43.196ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d"), full_name: "oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d" } file = sled-storage/src/manager.rs:1431
5532025-01-17T07:58:43.281ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-17T07:58:43.281ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5552025-01-17T07:58:43.281ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/debug"), full_name: "oxp_24cecd51-2313-4198-99e2-aa6943e55b03/crypt/debug" } file = sled-storage/src/manager.rs:1431
5562025-01-17T07:58:43.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-17T07:58:43.325ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5582025-01-17T07:58:43.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14"), full_name: "oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14" } file = sled-storage/src/manager.rs:1431
5592025-01-17T07:58:43.406ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-01-17T07:58:43.406ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5612025-01-17T07:58:43.406ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crucible" } file = sled-storage/src/manager.rs:1431
5622025-01-17T07:58:43.482ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-01-17T07:58:43.482ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642025-01-17T07:58:43.482ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone/oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0"), full_name: "oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/zone/oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0" } file = sled-storage/src/manager.rs:1431
5652025-01-17T07:58:43.511ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
5662025-01-17T07:58:43.564ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672025-01-17T07:58:43.564ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682025-01-17T07:58:43.564ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680" } file = sled-storage/src/manager.rs:1431
5692025-01-17T07:58:43.646ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702025-01-17T07:58:43.646ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5712025-01-17T07:58:43.646ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/debug"), full_name: "oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/debug" } file = sled-storage/src/manager.rs:1431
5722025-01-17T07:58:43.686ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732025-01-17T07:58:43.687ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742025-01-17T07:58:43.687ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19" } file = sled-storage/src/manager.rs:1431
5752025-01-17T07:58:43.769ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762025-01-17T07:58:43.769ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5772025-01-17T07:58:43.769ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0"), full_name: "oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone/oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0" } file = sled-storage/src/manager.rs:1431
5782025-01-17T07:58:43.857ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-01-17T07:58:43.857ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802025-01-17T07:58:43.857ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5812025-01-17T07:58:43.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822025-01-17T07:58:43.930ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5832025-01-17T07:58:43.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone"), full_name: "oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/zone" } file = sled-storage/src/manager.rs:1431
5842025-01-17T07:58:43.973ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852025-01-17T07:58:43.973ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862025-01-17T07:58:43.973ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5872025-01-17T07:58:44.050ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882025-01-17T07:58:44.050ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892025-01-17T07:58:44.050ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077" } file = sled-storage/src/manager.rs:1431
5902025-01-17T07:58:44.134ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912025-01-17T07:58:44.134ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5922025-01-17T07:58:44.134ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2"), full_name: "oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2" } file = sled-storage/src/manager.rs:1431
5932025-01-17T07:58:44.218ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-01-17T07:58:44.218ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5952025-01-17T07:58:44.218ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone" } file = sled-storage/src/manager.rs:1431
5962025-01-17T07:58:44.260ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-01-17T07:58:44.260ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5982025-01-17T07:58:44.260ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/zone/oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680" } file = sled-storage/src/manager.rs:1431
5992025-01-17T07:58:44.343ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002025-01-17T07:58:44.343ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6012025-01-17T07:58:44.343ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6022025-01-17T07:58:44.413ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032025-01-17T07:58:44.413ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6042025-01-17T07:58:44.413ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone"), full_name: "oxp_03539269-b412-4961-92af-cf162b13a30f/crypt/zone" } file = sled-storage/src/manager.rs:1431
6052025-01-17T07:58:44.455ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062025-01-17T07:58:44.455ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6072025-01-17T07:58:44.455ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/debug"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/debug" } file = sled-storage/src/manager.rs:1431
6082025-01-17T07:58:44.503ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092025-01-17T07:58:44.503ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102025-01-17T07:58:44.503ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442"), full_name: "oxp_03539269-b412-4961-92af-cf162b13a30f/crypt/zone/oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442" } file = sled-storage/src/manager.rs:1431
6112025-01-17T07:58:44.514ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
6122025-01-17T07:58:44.586ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-01-17T07:58:44.586ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142025-01-17T07:58:44.586ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6152025-01-17T07:58:44.665ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-01-17T07:58:44.665ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172025-01-17T07:58:44.665ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
6182025-01-17T07:58:44.742ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-01-17T07:58:44.742ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202025-01-17T07:58:44.742ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047"), full_name: "oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/zone/oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047" } file = sled-storage/src/manager.rs:1431
6212025-01-17T07:58:44.823ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-01-17T07:58:44.823ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232025-01-17T07:58:44.823ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/zone/oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef" } file = sled-storage/src/manager.rs:1431
6242025-01-17T07:58:44.904ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-01-17T07:58:44.904ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6262025-01-17T07:58:44.904ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/debug"), full_name: "oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/debug" } file = sled-storage/src/manager.rs:1431
6272025-01-17T07:58:44.951ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282025-01-17T07:58:44.951ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6292025-01-17T07:58:44.951ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/zone"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/zone" } file = sled-storage/src/manager.rs:1431
6302025-01-17T07:58:44.996ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-01-17T07:58:44.996ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6322025-01-17T07:58:44.996ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e"), full_name: "oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/zone/oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e" } file = sled-storage/src/manager.rs:1431
6332025-01-17T07:58:45.120ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342025-01-17T07:58:45.120ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352025-01-17T07:58:45.120ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crucible" } file = sled-storage/src/manager.rs:1431
6362025-01-17T07:58:45.196ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372025-01-17T07:58:45.196ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382025-01-17T07:58:45.196ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c"), full_name: "oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crypt/zone/oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c" } file = sled-storage/src/manager.rs:1431
6392025-01-17T07:58:45.286ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402025-01-17T07:58:45.286ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412025-01-17T07:58:45.286ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5/crucible" } file = sled-storage/src/manager.rs:1431
6422025-01-17T07:58:45.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432025-01-17T07:58:45.362ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442025-01-17T07:58:45.362ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506"), full_name: "oxp_24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506" } file = sled-storage/src/manager.rs:1431
6452025-01-17T07:58:45.445ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462025-01-17T07:58:45.445ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472025-01-17T07:58:45.445ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_22491af9-677c-492c-b09f-dd32d6d37612/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6482025-01-17T07:58:45.516ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
6492025-01-17T07:58:45.523ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502025-01-17T07:58:45.523ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6512025-01-17T07:58:45.523ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/debug"), full_name: "oxp_9813f791-8da3-471c-9021-42fd85d77240/crypt/debug" } file = sled-storage/src/manager.rs:1431
6522025-01-17T07:58:45.570ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6532025-01-17T07:58:45.570ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6542025-01-17T07:58:45.570ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df"), full_name: "oxp_24cecd51-2313-4198-99e2-aa6943e55b03/crypt/zone/oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df" } file = sled-storage/src/manager.rs:1431
6552025-01-17T07:58:45.652ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6562025-01-17T07:58:45.652ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6572025-01-17T07:58:45.653ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
6582025-01-17T07:58:45.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4660221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:50294 req_id = 99c7f4a3-4897-4d52-8ffb-c72a01196c0b response_code = 200 uri = /datasets
6592025-01-17T07:58:45.685ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6602025-01-17T07:58:45.685ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37696
6612025-01-17T07:58:45.685ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-01-17T07:58:45.685ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-01-17T07:58:45.694ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642025-01-17T07:58:45.694ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652025-01-17T07:58:45.702ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6662025-01-17T07:58:45.702ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6672025-01-17T07:58:45.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-17T07:58:45.711ZINFOSledAgent (ServiceManager): No ledger in /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:188
6692025-01-17T07:58:45.711ZINFOSledAgent (ServiceManager): No ledger in /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:188
6702025-01-17T07:58:45.711ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-01-17T07:58:45.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-01-17T07:58:45.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6732025-01-17T07:58:45.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6742025-01-17T07:58:45.810ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680 file = illumos-utils/src/zone.rs:325
6752025-01-17T07:58:45.814ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 file = illumos-utils/src/zone.rs:325
6762025-01-17T07:58:45.819ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b file = illumos-utils/src/zone.rs:325
6772025-01-17T07:58:45.832ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680 file = illumos-utils/src/zone.rs:363
6782025-01-17T07:58:45.837ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 file = illumos-utils/src/zone.rs:363
6792025-01-17T07:58:45.841ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b file = illumos-utils/src/zone.rs:363
6802025-01-17T07:58:46.310ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1821460767052802764 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
6812025-01-17T07:58:46.310ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11981951346767254845 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
6822025-01-17T07:58:46.324ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6832025-01-17T07:58:46.324ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6842025-01-17T07:58:46.331ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6852025-01-17T07:58:46.331ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6862025-01-17T07:58:46.480ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
6872025-01-17T07:58:46.480ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
6882025-01-17T07:58:46.518ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/probe_manager.rs:231 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
6892025-01-17T07:58:46.519ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
6902025-01-17T07:58:46.519ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
6912025-01-17T07:58:46.574ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
6922025-01-17T07:58:46.574ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
6932025-01-17T07:58:46.594ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
6942025-01-17T07:58:46.594ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
6952025-01-17T07:58:46.662ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
6962025-01-17T07:58:46.662ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
6972025-01-17T07:58:46.759ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
6982025-01-17T07:58:46.759ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6992025-01-17T07:58:46.792ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7002025-01-17T07:58:46.793ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/d7936c62-666e-4e9a-9d0d-121ba64013ad) file = sled-agent/src/nexus.rs:527 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
7012025-01-17T07:58:46.825ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7022025-01-17T07:58:46.825ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7032025-01-17T07:58:46.825ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7042025-01-17T07:58:46.825ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7052025-01-17T07:58:46.862ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7062025-01-17T07:58:46.915ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7072025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7082025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7092025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7102025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7112025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7122025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7132025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7142025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7152025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7162025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7172025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7182025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7192025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7202025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7212025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7222025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7232025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7242025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7252025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7262025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7272025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7282025-01-17T07:58:46.915ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7292025-01-17T07:58:47.473ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7302025-01-17T07:58:47.473ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
7312025-01-17T07:58:47.473ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7322025-01-17T07:58:47.477ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10255916408389122773 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
7332025-01-17T07:58:47.477ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 302010842147663326 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
7342025-01-17T07:58:47.959ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7352025-01-17T07:58:47.959ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
7362025-01-17T07:58:48.442ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7372025-01-17T07:58:48.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52") failed: Property not found. retry in 36.812185ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7382025-01-17T07:58:48.450ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7392025-01-17T07:58:48.454ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
7402025-01-17T07:58:48.454ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7412025-01-17T07:58:48.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52") failed: Property not found. retry in 108.63605ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7422025-01-17T07:58:48.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 40.390225ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7432025-01-17T07:58:48.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680") failed: Property not found. retry in 31.687813ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7442025-01-17T07:58:48.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52") failed: Property not found. retry in 255.234759ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7452025-01-17T07:58:48.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680") failed: Property not found. retry in 90.463658ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7462025-01-17T07:58:48.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 99.469501ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7472025-01-17T07:58:48.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680") failed: Property not found. retry in 274.013729ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7482025-01-17T07:58:48.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 137.805875ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7492025-01-17T07:58:48.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52") failed: Property not found. retry in 205.528653ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7502025-01-17T07:58:48.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 346.963953ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7512025-01-17T07:58:49.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680") failed: Property not found. retry in 332.22487ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7522025-01-17T07:58:49.111ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52") failed: Property not found. retry in 1.176836517s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7532025-01-17T07:58:49.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 672.251089ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7542025-01-17T07:58:49.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680") failed: Property not found. retry in 1.136310121s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7552025-01-17T07:58:49.983ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 955.421693ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7562025-01-17T07:58:50.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52") failed: Property not found. retry in 596.894099ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7572025-01-17T07:58:50.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680") failed: Property not found. retry in 873.216422ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7582025-01-17T07:58:50.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52") failed: Property not found. retry in 1.079702209s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7592025-01-17T07:58:50.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 977.870405ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7602025-01-17T07:58:51.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680") failed: Property not found. retry in 975.746795ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7612025-01-17T07:58:51.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 565.03547ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7622025-01-17T07:58:51.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52") failed: Property not found. retry in 1.08227536s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7632025-01-17T07:58:52.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680") failed: Property not found. retry in 802.310729ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7642025-01-17T07:58:52.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 576.364725ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7652025-01-17T07:58:53.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52") failed: Property not found. retry in 883.372407ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7662025-01-17T07:58:53.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b") failed: Property not found. retry in 1.384899473s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7672025-01-17T07:58:53.199ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680") failed: Property not found. retry in 997.561122ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7682025-01-17T07:58:54.499ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_3bc212dc-d611-4b5c-858e-4142ed451680
7692025-01-17T07:58:54.499ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_d5a59f8c-6bb3-4ff2-bc33-1e731e522b52
7702025-01-17T07:58:54.499ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_966305ce-37a0-4ee3-9a41-e8a9d746068b
7712025-01-17T07:58:54.499ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7722025-01-17T07:58:54.500ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7732025-01-17T07:58:54.500ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8814837 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37696 req_id = caf10877-5245-4065-8035-0a7dd4bef1b8 response_code = 204 uri = /omicron-zones
7742025-01-17T07:58:54.502ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7752025-01-17T07:58:54.860ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 89.976435ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config): client error (Connect): tcp connect error: Connection refused (os error 146): Connection refused (os error 146) file = sled-agent/src/rack_setup/service.rs:678
7762025-01-17T07:58:54.974ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7772025-01-17T07:58:55.028ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7782025-01-17T07:58:55.086ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7792025-01-17T07:58:55.086ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7802025-01-17T07:58:55.118ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7812025-01-17T07:58:55.119ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7822025-01-17T07:58:55.119ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7832025-01-17T07:58:55.148ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fa5ecd9e-2aba-4b83-ab70-a7a7b01fa00b, kind: Service { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df }, name: Name("ntp-6d52241f-03b5-4c15-8137-11fc02b9e9df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7842025-01-17T07:58:55.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60857
7852025-01-17T07:58:55.149ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7862025-01-17T07:58:55.149ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7872025-01-17T07:58:55.160ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7882025-01-17T07:58:55.160ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7892025-01-17T07:58:55.169ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7902025-01-17T07:58:55.169ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7912025-01-17T07:58:55.179ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7922025-01-17T07:58:55.179ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
7932025-01-17T07:58:55.179ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
7942025-01-17T07:58:55.179ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7952025-01-17T07:58:55.190ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7962025-01-17T07:58:55.222ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7972025-01-17T07:58:55.223ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7982025-01-17T07:58:55.223ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7992025-01-17T07:58:55.253ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 255, 48]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
8002025-01-17T07:58:55.253ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
8012025-01-17T07:58:55.254ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
8022025-01-17T07:58:55.254ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
8032025-01-17T07:58:55.254ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
8042025-01-17T07:58:55.255ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8052025-01-17T07:58:55.277ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df file = illumos-utils/src/zone.rs:325
8062025-01-17T07:58:55.295ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df file = illumos-utils/src/zone.rs:363
8072025-01-17T07:58:55.964ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
8082025-01-17T07:58:55.964ZINFOSledAgent (ServiceManager): Booting oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8092025-01-17T07:58:56.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df") failed: Property not found. retry in 37.003122ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8102025-01-17T07:58:56.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df") failed: Property not found. retry in 125.39503ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8112025-01-17T07:58:56.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df") failed: Property not found. retry in 225.861629ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8122025-01-17T07:58:56.313ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1821460767052802764 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8132025-01-17T07:58:56.313ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11981951346767254845 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8142025-01-17T07:58:56.514ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df") failed: Property not found. retry in 444.683485ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8152025-01-17T07:58:56.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df") failed: Property not found. retry in 1.148913428s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8162025-01-17T07:58:57.479ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10255916408389122773 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8172025-01-17T07:58:57.479ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 302010842147663326 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8182025-01-17T07:58:58.126ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df") failed: Property not found. retry in 1.411912145s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8192025-01-17T07:58:59.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df") failed: Property not found. retry in 769.654644ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8202025-01-17T07:59:00.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df") failed: Property not found. retry in 1.450285836s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8212025-01-17T07:59:01.796ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df
8222025-01-17T07:59:01.796ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8232025-01-17T07:59:01.796ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8242025-01-17T07:59:01.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6648104 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60857 req_id = 9252291f-2f5f-4861-9a27-6cfc806da309 response_code = 204 uri = /omicron-zones
8252025-01-17T07:59:01.799ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8262025-01-17T07:59:01.829ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8272025-01-17T07:59:01.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63609
8282025-01-17T07:59:01.838ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8292025-01-17T07:59:01.838ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9022 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63609 req_id = e39aa289-c8e4-47b8-854e-a7271d6fb36b response_code = 500 uri = /timesync
8302025-01-17T07:59:01.840ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8312025-01-17T07:59:01.924ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8322025-01-17T07:59:01.925ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53007
8332025-01-17T07:59:03.933ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8342025-01-17T07:59:03.933ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 2008764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53007 req_id = 42cd915f-ea01-4da0-a7f6-0c2aaae91d97 response_code = 500 uri = /timesync
8352025-01-17T07:59:03.936ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8362025-01-17T07:59:03.994ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10853025538690402961 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8372025-01-17T07:59:04.031ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382025-01-17T07:59:04.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58826
8392025-01-17T07:59:04.040ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8402025-01-17T07:59:04.040ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8940 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58826 req_id = 33dd49ab-7858-481c-80c4-94f2bb42d93a response_code = 500 uri = /timesync
8412025-01-17T07:59:04.043ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8422025-01-17T07:59:04.214ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8432025-01-17T07:59:04.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65342
8442025-01-17T07:59:04.223ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8179113758642148423 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8452025-01-17T07:59:04.502ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5183043889980799109 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8462025-01-17T07:59:06.316ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1821460767052802764 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8472025-01-17T07:59:06.316ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 11981951346767254845 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8482025-01-17T07:59:07.480ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10255916408389122773 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8492025-01-17T07:59:07.480ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 302010842147663326 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
8502025-01-17T07:59:08.466ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_6d52241f-03b5-4c15-8137-11fc02b9e9df': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8512025-01-17T07:59:08.466ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009518 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65342 req_id = 6232fdd1-9f01-499b-8489-46591bbf1586 response_code = 500 uri = /timesync
8522025-01-17T07:59:08.469ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-01-17T07:59:08.686ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542025-01-17T07:59:08.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55778
8552025-01-17T07:59:08.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8698 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55778 req_id = 15ed3cb0-bc86-46b1-8455-4856d137f3dc response_code = 200 uri = /timesync
8562025-01-17T07:59:08.698ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8572025-01-17T07:59:08.698ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-01-17T07:59:09.197ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592025-01-17T07:59:09.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50936
8602025-01-17T07:59:09.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 21496 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50936 req_id = 6bf07dce-15af-492c-86f2-109536cd80cf response_code = 200 uri = /timesync
8612025-01-17T07:59:09.222ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1078944965, ip_addr: 64.79.100.197, stratum: 3, ref_time: 1737100749.0400355, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8622025-01-17T07:59:09.222ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
8632025-01-17T07:59:09.254ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fa5ecd9e-2aba-4b83-ab70-a7a7b01fa00b, kind: Service { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df }, name: Name("ntp-6d52241f-03b5-4c15-8137-11fc02b9e9df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9d3d9cbb-4352-4488-94e7-a380185fc410 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7a125ea5-1884-445a-8e39-149e46827680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 58dd6d93-c593-4bb6-a589-d4523c0221f0 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } } } }, OmicronZoneConfig { id: b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76bacbdd-6992-4c81-86b4-ec19857d7759 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8642025-01-17T07:59:09.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43179
8652025-01-17T07:59:09.254ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8662025-01-17T07:59:09.254ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8672025-01-17T07:59:09.265ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8682025-01-17T07:59:09.265ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8692025-01-17T07:59:09.274ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8702025-01-17T07:59:09.274ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
8712025-01-17T07:59:09.284ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8722025-01-17T07:59:09.284ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8732025-01-17T07:59:09.293ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8742025-01-17T07:59:09.293ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8752025-01-17T07:59:09.302ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8762025-01-17T07:59:09.302ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
8772025-01-17T07:59:09.312ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8782025-01-17T07:59:09.312ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8792025-01-17T07:59:09.321ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
8802025-01-17T07:59:09.321ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }
8812025-01-17T07:59:09.330ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8822025-01-17T07:59:09.330ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
8832025-01-17T07:59:09.330ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
8842025-01-17T07:59:09.330ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
8852025-01-17T07:59:09.362ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
8862025-01-17T07:59:09.362ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
8872025-01-17T07:59:09.362ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
8882025-01-17T07:59:09.362ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
8892025-01-17T07:59:09.362ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
8902025-01-17T07:59:09.362ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2", TimeNotSynchronized), ("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0", TimeNotSynchronized), ("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759", TimeNotSynchronized), ("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410", TimeNotSynchronized), ("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 107727 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43179 req_id = 48b5139e-ed13-4fa1-8b8b-8aa13fc50e56 response_code = 500 uri = /omicron-zones
8912025-01-17T07:59:09.362ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "48b5139e-ed13-4fa1-8b8b-8aa13fc50e56", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:08 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "48b5139e-ed13-4fa1-8b8b-8aa13fc50e56" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 64.464999ms sled_address = [fd00:1122:3344:101::1]:12345
8922025-01-17T07:59:09.427ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fa5ecd9e-2aba-4b83-ab70-a7a7b01fa00b, kind: Service { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df }, name: Name("ntp-6d52241f-03b5-4c15-8137-11fc02b9e9df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9d3d9cbb-4352-4488-94e7-a380185fc410 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7a125ea5-1884-445a-8e39-149e46827680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 58dd6d93-c593-4bb6-a589-d4523c0221f0 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } } } }, OmicronZoneConfig { id: b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76bacbdd-6992-4c81-86b4-ec19857d7759 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
8932025-01-17T07:59:09.428ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8942025-01-17T07:59:09.428ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8952025-01-17T07:59:09.438ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8962025-01-17T07:59:09.438ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
8972025-01-17T07:59:09.448ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
8982025-01-17T07:59:09.448ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
8992025-01-17T07:59:09.457ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9002025-01-17T07:59:09.457ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9012025-01-17T07:59:09.466ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9022025-01-17T07:59:09.466ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9032025-01-17T07:59:09.477ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9042025-01-17T07:59:09.477ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9052025-01-17T07:59:09.486ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9062025-01-17T07:59:09.486ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9072025-01-17T07:59:09.495ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9082025-01-17T07:59:09.495ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9092025-01-17T07:59:09.505ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9102025-01-17T07:59:09.505ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
9112025-01-17T07:59:09.505ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
9122025-01-17T07:59:09.505ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9132025-01-17T07:59:09.538ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
9142025-01-17T07:59:09.538ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
9152025-01-17T07:59:09.538ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
9162025-01-17T07:59:09.538ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
9172025-01-17T07:59:09.538ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
9182025-01-17T07:59:09.538ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680", TimeNotSynchronized), ("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0", TimeNotSynchronized), ("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410", TimeNotSynchronized), ("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2", TimeNotSynchronized), ("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 110712 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43179 req_id = ca3c8656-0e52-4823-b0f8-5a3116adffa8 response_code = 500 uri = /omicron-zones
9192025-01-17T07:59:09.538ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ca3c8656-0e52-4823-b0f8-5a3116adffa8", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ca3c8656-0e52-4823-b0f8-5a3116adffa8" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 118.7826ms sled_address = [fd00:1122:3344:101::1]:12345
9202025-01-17T07:59:09.659ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fa5ecd9e-2aba-4b83-ab70-a7a7b01fa00b, kind: Service { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df }, name: Name("ntp-6d52241f-03b5-4c15-8137-11fc02b9e9df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9d3d9cbb-4352-4488-94e7-a380185fc410 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7a125ea5-1884-445a-8e39-149e46827680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 58dd6d93-c593-4bb6-a589-d4523c0221f0 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } } } }, OmicronZoneConfig { id: b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76bacbdd-6992-4c81-86b4-ec19857d7759 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9212025-01-17T07:59:09.659ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9222025-01-17T07:59:09.659ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9232025-01-17T07:59:09.669ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9242025-01-17T07:59:09.669ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9252025-01-17T07:59:09.679ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9262025-01-17T07:59:09.679ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
9272025-01-17T07:59:09.689ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9282025-01-17T07:59:09.689ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9292025-01-17T07:59:09.698ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9302025-01-17T07:59:09.698ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9312025-01-17T07:59:09.708ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9322025-01-17T07:59:09.708ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9332025-01-17T07:59:09.716ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9342025-01-17T07:59:09.716ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9352025-01-17T07:59:09.725ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9362025-01-17T07:59:09.725ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9372025-01-17T07:59:09.733ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9382025-01-17T07:59:09.734ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
9392025-01-17T07:59:09.734ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
9402025-01-17T07:59:09.734ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9412025-01-17T07:59:09.765ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
9422025-01-17T07:59:09.765ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
9432025-01-17T07:59:09.765ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
9442025-01-17T07:59:09.765ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
9452025-01-17T07:59:09.765ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
9462025-01-17T07:59:09.765ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680", TimeNotSynchronized), ("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0", TimeNotSynchronized), ("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759", TimeNotSynchronized), ("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410", TimeNotSynchronized), ("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 106622 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43179 req_id = 556f1e0f-a552-4078-894d-a221b911d065 response_code = 500 uri = /omicron-zones
9472025-01-17T07:59:09.766ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "556f1e0f-a552-4078-894d-a221b911d065", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "556f1e0f-a552-4078-894d-a221b911d065" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 160.85213ms sled_address = [fd00:1122:3344:101::1]:12345
9482025-01-17T07:59:10.041ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fa5ecd9e-2aba-4b83-ab70-a7a7b01fa00b, kind: Service { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df }, name: Name("ntp-6d52241f-03b5-4c15-8137-11fc02b9e9df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9d3d9cbb-4352-4488-94e7-a380185fc410 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7a125ea5-1884-445a-8e39-149e46827680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 58dd6d93-c593-4bb6-a589-d4523c0221f0 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } } } }, OmicronZoneConfig { id: b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76bacbdd-6992-4c81-86b4-ec19857d7759 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9492025-01-17T07:59:10.041ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9502025-01-17T07:59:10.041ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9512025-01-17T07:59:10.051ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9522025-01-17T07:59:10.051ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9532025-01-17T07:59:10.061ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9542025-01-17T07:59:10.061ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
9552025-01-17T07:59:10.070ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9562025-01-17T07:59:10.070ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9572025-01-17T07:59:10.079ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9582025-01-17T07:59:10.079ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9592025-01-17T07:59:10.088ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9602025-01-17T07:59:10.088ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9612025-01-17T07:59:10.097ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9622025-01-17T07:59:10.097ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9632025-01-17T07:59:10.106ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9642025-01-17T07:59:10.106ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9652025-01-17T07:59:10.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9662025-01-17T07:59:10.115ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
9672025-01-17T07:59:10.115ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
9682025-01-17T07:59:10.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9692025-01-17T07:59:10.147ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
9702025-01-17T07:59:10.148ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
9712025-01-17T07:59:10.148ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
9722025-01-17T07:59:10.148ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
9732025-01-17T07:59:10.148ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
9742025-01-17T07:59:10.148ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410", TimeNotSynchronized), ("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0", TimeNotSynchronized), ("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2", TimeNotSynchronized), ("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759", TimeNotSynchronized), ("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 106576 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43179 req_id = 0a46a214-76c8-462e-a00e-ce44d2a686bb response_code = 500 uri = /omicron-zones
9752025-01-17T07:59:10.148ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0a46a214-76c8-462e-a00e-ce44d2a686bb", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0a46a214-76c8-462e-a00e-ce44d2a686bb" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 253.118665ms sled_address = [fd00:1122:3344:101::1]:12345
9762025-01-17T07:59:10.401ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fa5ecd9e-2aba-4b83-ab70-a7a7b01fa00b, kind: Service { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df }, name: Name("ntp-6d52241f-03b5-4c15-8137-11fc02b9e9df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9d3d9cbb-4352-4488-94e7-a380185fc410 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7a125ea5-1884-445a-8e39-149e46827680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 58dd6d93-c593-4bb6-a589-d4523c0221f0 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } } } }, OmicronZoneConfig { id: b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76bacbdd-6992-4c81-86b4-ec19857d7759 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9772025-01-17T07:59:10.402ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9782025-01-17T07:59:10.402ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9792025-01-17T07:59:10.411ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9802025-01-17T07:59:10.411ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9812025-01-17T07:59:10.420ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9822025-01-17T07:59:10.420ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
9832025-01-17T07:59:10.429ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9842025-01-17T07:59:10.429ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9852025-01-17T07:59:10.438ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9862025-01-17T07:59:10.438ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9872025-01-17T07:59:10.447ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9882025-01-17T07:59:10.447ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
9892025-01-17T07:59:10.456ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9902025-01-17T07:59:10.456ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9912025-01-17T07:59:10.465ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9922025-01-17T07:59:10.465ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9932025-01-17T07:59:10.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9942025-01-17T07:59:10.474ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
9952025-01-17T07:59:10.474ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
9962025-01-17T07:59:10.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9972025-01-17T07:59:10.508ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
9982025-01-17T07:59:10.508ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
9992025-01-17T07:59:10.508ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
10002025-01-17T07:59:10.508ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
10012025-01-17T07:59:10.508ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
10022025-01-17T07:59:10.508ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0", TimeNotSynchronized), ("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410", TimeNotSynchronized), ("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680", TimeNotSynchronized), ("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2", TimeNotSynchronized), ("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 106403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43179 req_id = 5bfd4e16-e1da-4277-8c68-90b94db2cab7 response_code = 500 uri = /omicron-zones
10032025-01-17T07:59:10.508ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5bfd4e16-e1da-4277-8c68-90b94db2cab7", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5bfd4e16-e1da-4277-8c68-90b94db2cab7" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 141.088493ms sled_address = [fd00:1122:3344:101::1]:12345
10042025-01-17T07:59:10.650ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fa5ecd9e-2aba-4b83-ab70-a7a7b01fa00b, kind: Service { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df }, name: Name("ntp-6d52241f-03b5-4c15-8137-11fc02b9e9df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9d3d9cbb-4352-4488-94e7-a380185fc410 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7a125ea5-1884-445a-8e39-149e46827680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 58dd6d93-c593-4bb6-a589-d4523c0221f0 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } } } }, OmicronZoneConfig { id: b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76bacbdd-6992-4c81-86b4-ec19857d7759 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10052025-01-17T07:59:10.651ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10062025-01-17T07:59:10.651ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10072025-01-17T07:59:10.660ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10082025-01-17T07:59:10.660ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10092025-01-17T07:59:10.669ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10102025-01-17T07:59:10.669ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
10112025-01-17T07:59:10.677ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10122025-01-17T07:59:10.677ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10132025-01-17T07:59:10.686ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10142025-01-17T07:59:10.686ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10152025-01-17T07:59:10.695ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10162025-01-17T07:59:10.695ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10172025-01-17T07:59:10.704ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10182025-01-17T07:59:10.704ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10192025-01-17T07:59:10.713ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10202025-01-17T07:59:10.713ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10212025-01-17T07:59:10.722ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10222025-01-17T07:59:10.722ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
10232025-01-17T07:59:10.722ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
10242025-01-17T07:59:10.723ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10252025-01-17T07:59:10.756ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
10262025-01-17T07:59:10.756ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
10272025-01-17T07:59:10.756ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
10282025-01-17T07:59:10.756ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
10292025-01-17T07:59:10.756ZWARNSledAgent (ServiceManager): Zone failed to start file = sled-agent/src/services.rs:3323 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
10302025-01-17T07:59:10.756ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to initialize zones: [("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0", TimeNotSynchronized), ("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680", TimeNotSynchronized), ("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2", TimeNotSynchronized), ("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759", TimeNotSynchronized), ("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410", TimeNotSynchronized)] file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 105873 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43179 req_id = 181f4d9e-5d23-4c71-b504-a1f5203d7f0b response_code = 500 uri = /omicron-zones
10312025-01-17T07:59:10.756ZWARNSledAgent (RSS): failed to initialize Omicron zones error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "181f4d9e-5d23-4c71-b504-a1f5203d7f0b", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:10 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "181f4d9e-5d23-4c71-b504-a1f5203d7f0b" } file = sled-agent/src/rack_setup/service.rs:578 retry_after = 204.142645ms sled_address = [fd00:1122:3344:101::1]:12345
10322025-01-17T07:59:10.962ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fa5ecd9e-2aba-4b83-ab70-a7a7b01fa00b, kind: Service { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df }, name: Name("ntp-6d52241f-03b5-4c15-8137-11fc02b9e9df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9d3d9cbb-4352-4488-94e7-a380185fc410 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7a125ea5-1884-445a-8e39-149e46827680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 58dd6d93-c593-4bb6-a589-d4523c0221f0 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } } } }, OmicronZoneConfig { id: b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76bacbdd-6992-4c81-86b4-ec19857d7759 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10332025-01-17T07:59:10.962ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10342025-01-17T07:59:10.962ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10352025-01-17T07:59:10.973ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10362025-01-17T07:59:10.973ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10372025-01-17T07:59:10.982ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10382025-01-17T07:59:10.982ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
10392025-01-17T07:59:10.991ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10402025-01-17T07:59:10.991ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10412025-01-17T07:59:11.001ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10422025-01-17T07:59:11.001ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10432025-01-17T07:59:11.010ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10442025-01-17T07:59:11.010ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10452025-01-17T07:59:11.019ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10462025-01-17T07:59:11.019ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10472025-01-17T07:59:11.028ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10482025-01-17T07:59:11.028ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10492025-01-17T07:59:11.036ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10502025-01-17T07:59:11.036ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
10512025-01-17T07:59:11.036ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
10522025-01-17T07:59:11.036ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10532025-01-17T07:59:11.119ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10542025-01-17T07:59:11.119ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10552025-01-17T07:59:11.119ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10562025-01-17T07:59:11.119ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10572025-01-17T07:59:11.119ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10582025-01-17T07:59:11.133ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 295.06844ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
10592025-01-17T07:59:11.214ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680 file = illumos-utils/src/zone.rs:325
10602025-01-17T07:59:11.218ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 file = illumos-utils/src/zone.rs:325
10612025-01-17T07:59:11.223ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759 file = illumos-utils/src/zone.rs:325
10622025-01-17T07:59:11.227ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 file = illumos-utils/src/zone.rs:325
10632025-01-17T07:59:11.232ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410 file = illumos-utils/src/zone.rs:325
10642025-01-17T07:59:11.237ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680 file = illumos-utils/src/zone.rs:363
10652025-01-17T07:59:11.241ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 file = illumos-utils/src/zone.rs:363
10662025-01-17T07:59:11.246ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759 file = illumos-utils/src/zone.rs:363
10672025-01-17T07:59:11.250ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 file = illumos-utils/src/zone.rs:363
10682025-01-17T07:59:11.255ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410 file = illumos-utils/src/zone.rs:363
10692025-01-17T07:59:14.249ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='9d3d9cbb-4352-4488-94e7-a380185fc410'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10702025-01-17T07:59:14.249ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
10712025-01-17T07:59:14.256ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='76bacbdd-6992-4c81-86b4-ec19857d7759'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10722025-01-17T07:59:14.256ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='58dd6d93-c593-4bb6-a589-d4523c0221f0'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10732025-01-17T07:59:14.256ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
10742025-01-17T07:59:14.261ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
10752025-01-17T07:59:14.266ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='7a125ea5-1884-445a-8e39-149e46827680'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10762025-01-17T07:59:14.266ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
10772025-01-17T07:59:14.289ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10782025-01-17T07:59:14.289ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
10792025-01-17T07:59:14.397ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 32.731115ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
10802025-01-17T07:59:14.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 41.222467ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
10812025-01-17T07:59:14.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 51.285115ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
10822025-01-17T07:59:14.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 50.235562ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
10832025-01-17T07:59:14.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 42.579938ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
10842025-01-17T07:59:14.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 144.764764ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
10852025-01-17T07:59:14.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 130.774454ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
10862025-01-17T07:59:14.639ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 108.573935ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
10872025-01-17T07:59:15.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 93.366312ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
10882025-01-17T07:59:15.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 52.076698ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
10892025-01-17T07:59:15.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 159.257635ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
10902025-01-17T07:59:15.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 188.211473ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
10912025-01-17T07:59:15.736ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 209.519256ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
10922025-01-17T07:59:15.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 182.71081ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
10932025-01-17T07:59:15.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 195.002137ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
10942025-01-17T07:59:15.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 487.93571ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
10952025-01-17T07:59:15.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 429.947344ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
10962025-01-17T07:59:15.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 288.009501ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
10972025-01-17T07:59:15.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 546.946359ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
10982025-01-17T07:59:16.000ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 590.279959ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
10992025-01-17T07:59:16.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 469.950962ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11002025-01-17T07:59:16.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 882.982511ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11012025-01-17T07:59:16.395ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 460.707527ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11022025-01-17T07:59:16.575ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 604.250177ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11032025-01-17T07:59:16.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 1.006067158s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11042025-01-17T07:59:16.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 1.11312254s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11052025-01-17T07:59:16.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 885.479393ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11062025-01-17T07:59:17.174ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46636
11072025-01-17T07:59:17.174ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46636 req_id = 947acdec-23f1-4dd0-9b74-1dd7120b7700 response_code = 200 uri = /baseboard
11082025-01-17T07:59:17.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 1.019843487s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11092025-01-17T07:59:17.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 1.368933408s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11102025-01-17T07:59:17.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 772.020335ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11112025-01-17T07:59:17.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 892.993368ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11122025-01-17T07:59:17.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 1.178712195s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11132025-01-17T07:59:18.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 1.449981167s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11142025-01-17T07:59:18.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 1.440995058s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11152025-01-17T07:59:18.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 1.220729189s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11162025-01-17T07:59:18.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 1.321726404s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11172025-01-17T07:59:19.075ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 572.870723ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11182025-01-17T07:59:19.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 1.008479158s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11192025-01-17T07:59:19.682ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 592.248173ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11202025-01-17T07:59:19.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 505.326984ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11212025-01-17T07:59:19.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 542.936403ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11222025-01-17T07:59:20.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 1.074543123s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11232025-01-17T07:59:20.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 502.263833ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11242025-01-17T07:59:20.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 601.107018ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11252025-01-17T07:59:20.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 1.226186721s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11262025-01-17T07:59:20.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 1.261385277s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11272025-01-17T07:59:20.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 1.199950324s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11282025-01-17T07:59:20.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 883.162132ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11292025-01-17T07:59:21.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 921.840559ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11302025-01-17T07:59:21.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 1.307346305s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11312025-01-17T07:59:21.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 1.23328889s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11322025-01-17T07:59:21.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 1.280308455s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11332025-01-17T07:59:22.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 1.283620485s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11342025-01-17T07:59:22.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 545.193291ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11352025-01-17T07:59:22.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 1.414000252s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11362025-01-17T07:59:22.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 1.120034382s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11372025-01-17T07:59:23.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 907.423593ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11382025-01-17T07:59:23.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 1.058032464s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11392025-01-17T07:59:23.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 673.435284ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11402025-01-17T07:59:23.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 778.634006ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11412025-01-17T07:59:24.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 714.438326ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11422025-01-17T07:59:24.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 697.579743ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11432025-01-17T07:59:24.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 590.67075ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11442025-01-17T07:59:24.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2") failed: Property not found. retry in 1.398566134s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11452025-01-17T07:59:24.716ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410") failed: Property not found. retry in 1.460863517s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11462025-01-17T07:59:24.735ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0") failed: Property not found. retry in 647.741477ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11472025-01-17T07:59:24.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759") failed: Property not found. retry in 605.854261ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11482025-01-17T07:59:24.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680") failed: Property not found. retry in 743.484332ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11492025-01-17T07:59:26.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_7a125ea5-1884-445a-8e39-149e46827680
11502025-01-17T07:59:26.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2
11512025-01-17T07:59:26.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_76bacbdd-6992-4c81-86b4-ec19857d7759
11522025-01-17T07:59:26.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0
11532025-01-17T07:59:26.202ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_9d3d9cbb-4352-4488-94e7-a380185fc410
11542025-01-17T07:59:26.202ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11552025-01-17T07:59:26.202ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11562025-01-17T07:59:26.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 15241227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:43179 req_id = 907906de-d88b-4b9f-b649-ae58f8a982fc response_code = 204 uri = /omicron-zones
11572025-01-17T07:59:26.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50423
11582025-01-17T07:59:26.269ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 32385 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = f3e90547-f654-43e2-801a-7c01723ac0e3 response_code = 500 uri = /cockroachdb
11592025-01-17T07:59:26.269ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f3e90547-f654-43e2-801a-7c01723ac0e3", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f3e90547-f654-43e2-801a-7c01723ac0e3" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 60.161777ms
11602025-01-17T07:59:26.357ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26525 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = dd337888-5c87-4098-b984-2a669518adf2 response_code = 500 uri = /cockroachdb
11612025-01-17T07:59:26.357ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dd337888-5c87-4098-b984-2a669518adf2", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dd337888-5c87-4098-b984-2a669518adf2" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 116.961709ms
11622025-01-17T07:59:26.503ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27500 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = c0d0a01f-c613-438a-b7f1-c9375c08b01d response_code = 500 uri = /cockroachdb
11632025-01-17T07:59:26.503ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c0d0a01f-c613-438a-b7f1-c9375c08b01d", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c0d0a01f-c613-438a-b7f1-c9375c08b01d" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 131.401907ms
11642025-01-17T07:59:26.505ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 441.256041ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
11652025-01-17T07:59:26.663ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26554 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = 8662102a-ba3a-43e4-96c6-dc9906b1b59e response_code = 500 uri = /cockroachdb
11662025-01-17T07:59:26.663ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8662102a-ba3a-43e4-96c6-dc9906b1b59e", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8662102a-ba3a-43e4-96c6-dc9906b1b59e" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 163.577605ms
11672025-01-17T07:59:26.855ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26598 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = 7eb6b4e3-be84-4ba7-a48b-df603136b08a response_code = 500 uri = /cockroachdb
11682025-01-17T07:59:26.855ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7eb6b4e3-be84-4ba7-a48b-df603136b08a", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7eb6b4e3-be84-4ba7-a48b-df603136b08a" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 296.922699ms
11692025-01-17T07:59:27.181ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = 76dd2b66-4f3d-4afe-a789-c95704c1dbd6 response_code = 500 uri = /cockroachdb
11702025-01-17T07:59:27.181ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "76dd2b66-4f3d-4afe-a789-c95704c1dbd6", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:26 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "76dd2b66-4f3d-4afe-a789-c95704c1dbd6" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 232.024442ms
11712025-01-17T07:59:27.442ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28214 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = eaf8e7b7-5c5e-40bd-bb25-1208e22ae630 response_code = 500 uri = /cockroachdb
11722025-01-17T07:59:27.443ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "eaf8e7b7-5c5e-40bd-bb25-1208e22ae630", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "eaf8e7b7-5c5e-40bd-bb25-1208e22ae630" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 311.687647ms
11732025-01-17T07:59:27.782ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26836 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = 211fdb05-e1d8-49e8-8470-730329f93fef response_code = 500 uri = /cockroachdb
11742025-01-17T07:59:27.783ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "211fdb05-e1d8-49e8-8470-730329f93fef", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "211fdb05-e1d8-49e8-8470-730329f93fef" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 293.473257ms
11752025-01-17T07:59:28.104ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26662 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = cb041c40-a4ee-4453-9e13-c001c7801a72 response_code = 500 uri = /cockroachdb
11762025-01-17T07:59:28.104ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cb041c40-a4ee-4453-9e13-c001c7801a72", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:27 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cb041c40-a4ee-4453-9e13-c001c7801a72" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 411.096214ms
11772025-01-17T07:59:28.544ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_58dd6d93-c593-4bb6-a589-d4523c0221f0 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 27207 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = 9891ef79-d994-4aae-b5a6-19d11c437e99 response_code = 500 uri = /cockroachdb
11782025-01-17T07:59:28.544ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9891ef79-d994-4aae-b5a6-19d11c437e99", "content-length": "124", "date": "Fri, 17 Jan 2025 07:59:28 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9891ef79-d994-4aae-b5a6-19d11c437e99" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 414.47574ms
11792025-01-17T07:59:28.989ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3752
11802025-01-17T07:59:40.841ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
11812025-01-17T07:59:44.591ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
11822025-01-17T07:59:44.592ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 15630051 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:50423 req_id = 7d5a4fad-9d2e-4986-926c-7dc7b418f36d response_code = 204 uri = /cockroachdb
11832025-01-17T07:59:44.604ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 703.738169ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
11842025-01-17T07:59:44.638ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 966305ce-37a0-4ee3-9a41-e8a9d746068b (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3bc212dc-d611-4b5c-858e-4142ed451680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d5a59f8c-6bb3-4ff2-bc33-1e731e522b52 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: fa5ecd9e-2aba-4b83-ab70-a7a7b01fa00b, kind: Service { id: 6d52241f-03b5-4c15-8137-11fc02b9e9df }, name: Name("ntp-6d52241f-03b5-4c15-8137-11fc02b9e9df"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 48])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 9d3d9cbb-4352-4488-94e7-a380185fc410 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 7a125ea5-1884-445a-8e39-149e46827680 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } } } }, OmicronZoneConfig { id: 58dd6d93-c593-4bb6-a589-d4523c0221f0 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } } } }, OmicronZoneConfig { id: b8f6b3d5-c5fc-4bb5-8c83-a552ea0602b2 (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 76bacbdd-6992-4c81-86b4-ec19857d7759 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 7091f564-4da9-4862-bb09-767c6ad5168d (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff (service), filesystem_pool: Some(ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 (service), filesystem_pool: Some(ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 46d20049-cc6b-49c9-910e-b68eff5badc7 (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: 2a034e2d-ed46-4215-a595-c73dfd705f68 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9fdfb25c-9743-4dd7-a951-58d87b8feb7c (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: ad41be94-88ad-4307-80f1-01815ba4aac3 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 795d94b5-1279-4d33-bb2a-72d7e9f02077 (service), filesystem_pool: Some(ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External } } } }, OmicronZoneConfig { id: 071a6992-9a1e-4c51-bafb-8b6c6292fd19 (service), filesystem_pool: Some(ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External } } } }, OmicronZoneConfig { id: dfe7a708-acf2-4323-87e2-04f8d0dbb993 (service), filesystem_pool: Some(ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External } } } }, OmicronZoneConfig { id: 101f6616-5329-4eab-a4f7-4de836bd812d (service), filesystem_pool: Some(ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External } } } }, OmicronZoneConfig { id: ce7da4c6-91bd-4f10-ba11-37b190e02d14 (service), filesystem_pool: Some(ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External } } } }, OmicronZoneConfig { id: d794aa3a-5dab-4875-b71d-e5a1e234bc7b (service), filesystem_pool: Some(ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External } } } }, OmicronZoneConfig { id: e67e6aa6-2a95-43c5-b570-c597a1f61506 (service), filesystem_pool: Some(ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2555c8f0-c6a3-4ad4-9096-1e3c080f27a0 (service), filesystem_pool: Some(ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External } } } }, OmicronZoneConfig { id: f7a5f59c-ecf5-4182-a00a-5f7007447442 (service), filesystem_pool: Some(ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11852025-01-17T07:59:44.638ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45267
11862025-01-17T07:59:44.641ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11872025-01-17T07:59:44.641ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11882025-01-17T07:59:44.655ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11892025-01-17T07:59:44.655ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11902025-01-17T07:59:44.665ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11912025-01-17T07:59:44.665ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: InternalDns }, responder: ... }
11922025-01-17T07:59:44.675ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11932025-01-17T07:59:44.675ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11942025-01-17T07:59:44.684ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11952025-01-17T07:59:44.685ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11962025-01-17T07:59:44.694ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11972025-01-17T07:59:44.694ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Cockroach }, responder: ... }
11982025-01-17T07:59:44.704ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11992025-01-17T07:59:44.704ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12002025-01-17T07:59:44.715ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12012025-01-17T07:59:44.715ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12022025-01-17T07:59:44.725ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12032025-01-17T07:59:44.725ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12042025-01-17T07:59:44.735ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12052025-01-17T07:59:44.735ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12062025-01-17T07:59:44.745ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12072025-01-17T07:59:44.745ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12082025-01-17T07:59:44.755ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12092025-01-17T07:59:44.755ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, kind: Crucible }, responder: ... }
12102025-01-17T07:59:44.764ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12112025-01-17T07:59:44.764ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, kind: Crucible }, responder: ... }
12122025-01-17T07:59:44.774ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12132025-01-17T07:59:44.774ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, kind: Crucible }, responder: ... }
12142025-01-17T07:59:44.783ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12152025-01-17T07:59:44.783ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, kind: Crucible }, responder: ... }
12162025-01-17T07:59:44.792ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12172025-01-17T07:59:44.792ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, kind: Crucible }, responder: ... }
12182025-01-17T07:59:44.801ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12192025-01-17T07:59:44.801ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, kind: Crucible }, responder: ... }
12202025-01-17T07:59:44.811ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12212025-01-17T07:59:44.811ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, kind: Crucible }, responder: ... }
12222025-01-17T07:59:44.820ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12232025-01-17T07:59:44.820ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, kind: Crucible }, responder: ... }
12242025-01-17T07:59:44.832ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12252025-01-17T07:59:44.832ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, kind: Crucible }, responder: ... }
12262025-01-17T07:59:44.842ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12272025-01-17T07:59:44.842ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
12282025-01-17T07:59:44.843ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
12292025-01-17T07:59:44.843ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12302025-01-17T07:59:44.956ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12312025-01-17T07:59:44.958ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12322025-01-17T07:59:44.974ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12332025-01-17T07:59:44.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12342025-01-17T07:59:44.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12352025-01-17T07:59:44.988ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12362025-01-17T07:59:44.988ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12372025-01-17T07:59:45.015ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12382025-01-17T07:59:45.015ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12392025-01-17T07:59:45.015ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12402025-01-17T07:59:45.156ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12412025-01-17T07:59:45.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12422025-01-17T07:59:45.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12432025-01-17T07:59:45.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12442025-01-17T07:59:45.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12452025-01-17T07:59:45.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12462025-01-17T07:59:45.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12472025-01-17T07:59:45.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12482025-01-17T07:59:45.231ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12492025-01-17T07:59:45.232ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b file = illumos-utils/src/zone.rs:325
12502025-01-17T07:59:45.236ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3 file = illumos-utils/src/zone.rs:325
12512025-01-17T07:59:45.242ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442 file = illumos-utils/src/zone.rs:325
12522025-01-17T07:59:45.248ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e file = illumos-utils/src/zone.rs:325
12532025-01-17T07:59:45.253ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d file = illumos-utils/src/zone.rs:325
12542025-01-17T07:59:45.259ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077 file = illumos-utils/src/zone.rs:325
12552025-01-17T07:59:45.431ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b file = illumos-utils/src/zone.rs:363
12562025-01-17T07:59:45.436ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3 file = illumos-utils/src/zone.rs:363
12572025-01-17T07:59:45.442ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442 file = illumos-utils/src/zone.rs:363
12582025-01-17T07:59:45.447ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e file = illumos-utils/src/zone.rs:363
12592025-01-17T07:59:45.451ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d file = illumos-utils/src/zone.rs:363
12602025-01-17T07:59:45.457ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077 file = illumos-utils/src/zone.rs:363
12612025-01-17T07:59:45.463ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7 file = illumos-utils/src/zone.rs:325
12622025-01-17T07:59:45.468ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68 file = illumos-utils/src/zone.rs:325
12632025-01-17T07:59:45.473ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19 file = illumos-utils/src/zone.rs:325
12642025-01-17T07:59:45.478ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c file = illumos-utils/src/zone.rs:325
12652025-01-17T07:59:45.484ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14 file = illumos-utils/src/zone.rs:325
12662025-01-17T07:59:45.490ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506 file = illumos-utils/src/zone.rs:325
12672025-01-17T07:59:45.496ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0 file = illumos-utils/src/zone.rs:325
12682025-01-17T07:59:45.503ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993 file = illumos-utils/src/zone.rs:325
12692025-01-17T07:59:45.569ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12702025-01-17T07:59:45.570ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7 file = illumos-utils/src/zone.rs:363
12712025-01-17T07:59:45.580ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68 file = illumos-utils/src/zone.rs:363
12722025-01-17T07:59:45.591ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19 file = illumos-utils/src/zone.rs:363
12732025-01-17T07:59:45.604ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c file = illumos-utils/src/zone.rs:363
12742025-01-17T07:59:45.613ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14 file = illumos-utils/src/zone.rs:363
12752025-01-17T07:59:45.621ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506 file = illumos-utils/src/zone.rs:363
12762025-01-17T07:59:45.630ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0 file = illumos-utils/src/zone.rs:363
12772025-01-17T07:59:45.638ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993 file = illumos-utils/src/zone.rs:363
12782025-01-17T07:59:45.702ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12792025-01-17T07:59:45.769ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12802025-01-17T07:59:45.885ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12812025-01-17T07:59:46.016ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12822025-01-17T07:59:46.028ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12832025-01-17T07:59:46.030ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12842025-01-17T07:59:46.099ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 230, 25]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12852025-01-17T07:59:46.099ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12862025-01-17T07:59:46.101ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12872025-01-17T07:59:46.101ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12882025-01-17T07:59:46.187ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 221, 209]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12892025-01-17T07:59:46.187ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12902025-01-17T07:59:46.188ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12912025-01-17T07:59:46.188ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12922025-01-17T07:59:46.246ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 255, 73]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12932025-01-17T07:59:46.246ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
12942025-01-17T07:59:46.247ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12952025-01-17T07:59:46.247ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12962025-01-17T07:59:46.310ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 249, 141]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12972025-01-17T07:59:46.310ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12982025-01-17T07:59:46.312ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12992025-01-17T07:59:46.312ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13002025-01-17T07:59:46.380ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 133, 241]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13012025-01-17T07:59:46.380ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13022025-01-17T07:59:46.392ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
13032025-01-17T07:59:46.392ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
13042025-01-17T07:59:46.392ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13052025-01-17T07:59:46.392ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13062025-01-17T07:59:46.392ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13072025-01-17T07:59:46.392ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13082025-01-17T07:59:46.392ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13092025-01-17T07:59:46.392ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13102025-01-17T07:59:46.395ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13112025-01-17T07:59:46.395ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13122025-01-17T07:59:46.415ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13132025-01-17T07:59:46.417ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13142025-01-17T07:59:46.471ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13152025-01-17T07:59:46.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13162025-01-17T07:59:46.475ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13172025-01-17T07:59:46.478ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13182025-01-17T07:59:46.478ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13192025-01-17T07:59:46.482ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13202025-01-17T07:59:46.482ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13212025-01-17T07:59:46.486ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13222025-01-17T07:59:46.696ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d file = illumos-utils/src/zone.rs:325
13232025-01-17T07:59:46.707ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2 file = illumos-utils/src/zone.rs:325
13242025-01-17T07:59:46.723ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047 file = illumos-utils/src/zone.rs:325
13252025-01-17T07:59:46.732ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff file = illumos-utils/src/zone.rs:325
13262025-01-17T07:59:46.739ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef file = illumos-utils/src/zone.rs:325
13272025-01-17T07:59:46.747ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d file = illumos-utils/src/zone.rs:363
13282025-01-17T07:59:46.756ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2 file = illumos-utils/src/zone.rs:363
13292025-01-17T07:59:46.768ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047 file = illumos-utils/src/zone.rs:363
13302025-01-17T07:59:46.776ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff file = illumos-utils/src/zone.rs:363
13312025-01-17T07:59:46.783ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef file = illumos-utils/src/zone.rs:363
13322025-01-17T07:59:47.304ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45252
13332025-01-17T07:59:47.312ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3734 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:45252 req_id = 53a70281-cf7e-4e6d-9c14-dcd2034692c1 response_code = 200 uri = /baseboard
13342025-01-17T07:59:53.778ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13352025-01-17T07:59:53.783ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13362025-01-17T07:59:53.783ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13372025-01-17T07:59:53.783ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
13382025-01-17T07:59:53.820ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
13392025-01-17T07:59:53.826ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
13402025-01-17T07:59:54.102ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_24cecd51-2313-4198-99e2-aa6943e55b03/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4eb9d450-8fb6-466c-9d90-934c8aef8bba'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13412025-01-17T07:59:54.103ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='057cebf8-4999-48fd-a385-6189bb36b195'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422025-01-17T07:59:54.103ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='67949060-cde5-444c-b751-daf56da7389b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13432025-01-17T07:59:54.103ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_03539269-b412-4961-92af-cf162b13a30f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4681aa41-19aa-4d8e-a4b2-b1859c23c531'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13442025-01-17T07:59:54.104ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='aca5dbf0-ff56-443b-8ce5-760018d45ace'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13452025-01-17T07:59:54.104ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_22491af9-677c-492c-b09f-dd32d6d37612/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='27d795e5-9e80-4077-bab8-897547ef07ac'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13462025-01-17T07:59:54.104ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fb743880-ceb4-4309-9fe1-855954a7a059/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2664230d-aba9-4d10-b6c6-4e2a8e002819'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13472025-01-17T07:59:54.104ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
13482025-01-17T07:59:54.112ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
13492025-01-17T07:59:54.118ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_11fc8969-6569-4e63-b863-6b5f04571d1f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='38da2e93-bf42-4714-8475-06fe64c2655b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13502025-01-17T07:59:54.118ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
13512025-01-17T07:59:54.125ZINFOSledAgent (ServiceManager): Booting oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
13522025-01-17T07:59:54.132ZINFOSledAgent (ServiceManager): Booting oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
13532025-01-17T07:59:54.138ZINFOSledAgent (ServiceManager): Booting oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
13542025-01-17T07:59:54.146ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9813f791-8da3-471c-9021-42fd85d77240/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0c0501ea-0812-43db-a171-e2b4077428f0'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13552025-01-17T07:59:54.146ZINFOSledAgent (ServiceManager): Booting oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
13562025-01-17T07:59:54.152ZINFOSledAgent (ServiceManager): Booting oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
13572025-01-17T07:59:54.159ZINFOSledAgent (ServiceManager): Booting oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
13582025-01-17T07:59:54.307ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='46d20049-cc6b-49c9-910e-b68eff5badc7'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13592025-01-17T07:59:54.307ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
13602025-01-17T07:59:54.890ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13612025-01-17T07:59:54.923ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13622025-01-17T07:59:54.923ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
13632025-01-17T07:59:54.931ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
13642025-01-17T07:59:55.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 39.065245ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
13652025-01-17T07:59:55.197ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 48.957112ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
13662025-01-17T07:59:55.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 51.396807ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
13672025-01-17T07:59:55.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 26.5711ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
13682025-01-17T07:59:55.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 58.018243ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
13692025-01-17T07:59:55.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 30.140577ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
13702025-01-17T07:59:55.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 65.805774ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
13712025-01-17T07:59:55.261ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 48.056848ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
13722025-01-17T07:59:55.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 73.049006ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
13732025-01-17T07:59:55.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 64.768383ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
13742025-01-17T07:59:55.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 69.907951ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
13752025-01-17T07:59:55.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 63.536198ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
13762025-01-17T07:59:55.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 44.308017ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
13772025-01-17T07:59:55.325ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 56.693836ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
13782025-01-17T07:59:55.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 50.357832ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
13792025-01-17T07:59:55.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 118.00061ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
13802025-01-17T07:59:55.362ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 116.229112ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
13812025-01-17T07:59:55.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 105.383279ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
13822025-01-17T07:59:55.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 104.66452ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
13832025-01-17T07:59:55.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 85.379719ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
13842025-01-17T07:59:55.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 114.206629ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
13852025-01-17T07:59:55.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 115.081201ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
13862025-01-17T07:59:55.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 146.590707ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
13872025-01-17T07:59:55.467ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 149.324369ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
13882025-01-17T07:59:55.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 60.540082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
13892025-01-17T07:59:55.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 76.319996ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
13902025-01-17T07:59:55.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 123.519103ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
13912025-01-17T07:59:55.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 100.227365ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
13922025-01-17T07:59:55.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 135.086527ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
13932025-01-17T07:59:55.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 119.136617ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
13942025-01-17T07:59:55.561ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 286.30703ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
13952025-01-17T07:59:55.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 170.13557ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
13962025-01-17T07:59:55.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 199.297324ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
13972025-01-17T07:59:55.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 113.679113ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
13982025-01-17T07:59:55.612ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 298.828396ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
13992025-01-17T07:59:55.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 159.765982ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
14002025-01-17T07:59:55.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 175.315715ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
14012025-01-17T07:59:55.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 235.07353ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
14022025-01-17T07:59:55.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 103.965616ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
14032025-01-17T07:59:55.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 231.537803ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
14042025-01-17T07:59:55.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 295.636908ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
14052025-01-17T07:59:55.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 201.160892ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
14062025-01-17T07:59:55.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 254.20711ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
14072025-01-17T07:59:55.722ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 241.083389ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
14082025-01-17T07:59:55.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 242.781328ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
14092025-01-17T07:59:55.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 330.590555ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
14102025-01-17T07:59:55.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 533.951989ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
14112025-01-17T07:59:55.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 382.692305ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
14122025-01-17T07:59:55.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 516.038428ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
14132025-01-17T07:59:55.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 500.083763ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
14142025-01-17T07:59:55.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 533.882676ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
14152025-01-17T07:59:55.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 541.110686ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
14162025-01-17T07:59:55.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 200.433796ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
14172025-01-17T07:59:55.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 567.251569ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
14182025-01-17T07:59:55.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 596.820766ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
14192025-01-17T07:59:55.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 504.94671ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
14202025-01-17T07:59:55.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 402.894656ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
14212025-01-17T07:59:56.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 591.767335ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
14222025-01-17T07:59:56.016ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 384.490557ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
14232025-01-17T07:59:56.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 520.361544ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
14242025-01-17T07:59:56.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.150973364s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
14252025-01-17T07:59:56.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 711.427884ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
14262025-01-17T07:59:56.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 580.967607ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
14272025-01-17T08:00:03.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 462.1718ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
14282025-01-17T08:00:03.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 962.271264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
14292025-01-17T08:00:03.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.069762838s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
14302025-01-17T08:00:03.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 818.975325ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
14312025-01-17T08:00:03.449ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.001792724s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
14322025-01-17T08:00:03.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 921.375445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
14332025-01-17T08:00:03.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.298742942s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
14342025-01-17T08:00:03.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 990.680316ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
14352025-01-17T08:00:03.688ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.328713533s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
14362025-01-17T08:00:03.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 703.603994ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
14372025-01-17T08:00:03.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 907.115148ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
14382025-01-17T08:00:03.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 718.114673ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
14392025-01-17T08:00:03.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 465.683161ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
14402025-01-17T08:00:03.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 718.97886ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
14412025-01-17T08:00:03.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.008332564s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
14422025-01-17T08:00:03.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.025483485s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
14432025-01-17T08:00:03.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 639.925169ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
14442025-01-17T08:00:04.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.43961312s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
14452025-01-17T08:00:04.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 719.859958ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
14462025-01-17T08:00:04.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.090957206s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
14472025-01-17T08:00:04.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.251940905s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
14482025-01-17T08:00:04.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 572.215534ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
14492025-01-17T08:00:04.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 574.329299ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
14502025-01-17T08:00:04.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 648.671516ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
14512025-01-17T08:00:04.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 668.187445ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
14522025-01-17T08:00:04.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 839.565898ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
14532025-01-17T08:00:04.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 1.079203945s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
14542025-01-17T08:00:04.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 756.775636ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
14552025-01-17T08:00:04.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 853.739309ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
14562025-01-17T08:00:04.698ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14572025-01-17T08:00:04.698ZINFOSledAgent (ServiceManager): Booting oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
14582025-01-17T08:00:04.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.15387377s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
14592025-01-17T08:00:04.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.430843598s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
14602025-01-17T08:00:04.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.025509088s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
14612025-01-17T08:00:04.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 61.271147ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
14622025-01-17T08:00:05.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 680.936162ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
14632025-01-17T08:00:05.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 1.023246073s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
14642025-01-17T08:00:05.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 634.033557ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
14652025-01-17T08:00:05.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 52.665041ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
14662025-01-17T08:00:05.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.092566119s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
14672025-01-17T08:00:05.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 1.015323413s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
14682025-01-17T08:00:05.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.446984693s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
14692025-01-17T08:00:05.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 275.532561ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
14702025-01-17T08:00:05.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 805.73182ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
14712025-01-17T08:00:05.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 656.266261ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
14722025-01-17T08:00:05.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 802.214969ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
14732025-01-17T08:00:05.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 898.129252ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
14742025-01-17T08:00:05.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 315.280645ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
14752025-01-17T08:00:05.668ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.093114291s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
14762025-01-17T08:00:05.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 564.850351ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
14772025-01-17T08:00:05.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.464865936s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
14782025-01-17T08:00:05.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 580.897993ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
14792025-01-17T08:00:05.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.184053376s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
14802025-01-17T08:00:05.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 448.439029ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
14812025-01-17T08:00:05.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.278420939s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
14822025-01-17T08:00:06.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.039261548s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
14832025-01-17T08:00:06.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 699.681755ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
14842025-01-17T08:00:06.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.231447591s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
14852025-01-17T08:00:06.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 1.211899269s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
14862025-01-17T08:00:06.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 868.665842ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
14872025-01-17T08:00:06.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 697.046236ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
14882025-01-17T08:00:06.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 1.159684341s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
14892025-01-17T08:00:06.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 773.10339ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
14902025-01-17T08:00:06.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 574.627626ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
14912025-01-17T08:00:06.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 868.078312ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
14922025-01-17T08:00:06.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.465748822s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
14932025-01-17T08:00:06.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.482485805s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
14942025-01-17T08:00:06.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.403202933s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
14952025-01-17T08:00:06.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 1.323327797s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
14962025-01-17T08:00:07.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 1.498940657s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
14972025-01-17T08:00:07.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 1.497907993s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
14982025-01-17T08:00:07.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 556.220275ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
14992025-01-17T08:00:07.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 755.939359ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
15002025-01-17T08:00:07.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.192501013s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
15012025-01-17T08:00:07.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 693.116754ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
15022025-01-17T08:00:07.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.018522552s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
15032025-01-17T08:00:07.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 653.675107ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
15042025-01-17T08:00:07.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 757.219851ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
15052025-01-17T08:00:07.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 1.258429199s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
15062025-01-17T08:00:07.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.433647287s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
15072025-01-17T08:00:07.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 970.559403ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
15082025-01-17T08:00:07.710ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.028487003s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
15092025-01-17T08:00:07.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 749.13296ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
15102025-01-17T08:00:07.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 670.8769ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
15112025-01-17T08:00:08.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 774.631253ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
15122025-01-17T08:00:08.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 638.190919ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
15132025-01-17T08:00:08.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 904.274307ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
15142025-01-17T08:00:08.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.217232965s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
15152025-01-17T08:00:08.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 716.55618ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
15162025-01-17T08:00:08.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 1.23794204s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
15172025-01-17T08:00:08.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.22493935s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
15182025-01-17T08:00:08.416ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.19340344s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
15192025-01-17T08:00:08.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 1.15528987s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
15202025-01-17T08:00:08.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 568.642376ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
15212025-01-17T08:00:08.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 1.388308332s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
15222025-01-17T08:00:08.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 922.617908ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
15232025-01-17T08:00:08.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.092823391s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
15242025-01-17T08:00:08.708ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 692.543392ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
15252025-01-17T08:00:08.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 713.748541ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
15262025-01-17T08:00:08.792ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 972.244349ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
15272025-01-17T08:00:08.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 965.755416ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
15282025-01-17T08:00:08.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 705.825938ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
15292025-01-17T08:00:09.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.395879722s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
15302025-01-17T08:00:09.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.285903797s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
15312025-01-17T08:00:09.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 982.457753ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
15322025-01-17T08:00:09.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 796.508135ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
15332025-01-17T08:00:09.472ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.243877006s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
15342025-01-17T08:00:09.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 727.912108ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
15352025-01-17T08:00:09.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 751.78329ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
15362025-01-17T08:00:09.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.113563884s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
15372025-01-17T08:00:09.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 535.206712ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
15382025-01-17T08:00:09.617ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 921.771471ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
15392025-01-17T08:00:09.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 503.15264ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
15402025-01-17T08:00:09.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 832.467461ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
15412025-01-17T08:00:09.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 675.799231ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
15422025-01-17T08:00:09.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 548.534547ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
15432025-01-17T08:00:09.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.166616083s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
15442025-01-17T08:00:09.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 1.376518022s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
15452025-01-17T08:00:10.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 938.087674ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
15462025-01-17T08:00:10.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 915.807918ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
15472025-01-17T08:00:10.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 500.814223ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
15482025-01-17T08:00:10.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.271283598s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
15492025-01-17T08:00:10.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 1.107354986s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
15502025-01-17T08:00:10.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 1.255482073s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
15512025-01-17T08:00:10.341ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.165327821s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
15522025-01-17T08:00:10.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 813.307062ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
15532025-01-17T08:00:10.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.089547699s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
15542025-01-17T08:00:10.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 796.003052ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
15552025-01-17T08:00:10.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 1.477165386s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
15562025-01-17T08:00:10.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 952.216847ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
15572025-01-17T08:00:10.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.252289038s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
15582025-01-17T08:00:10.706ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15592025-01-17T08:00:10.706ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15602025-01-17T08:00:10.706ZINFOSledAgent (ServiceManager): Booting oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
15612025-01-17T08:00:10.713ZINFOSledAgent (ServiceManager): Booting oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
15622025-01-17T08:00:10.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 911.52372ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
15632025-01-17T08:00:10.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 913.572414ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
15642025-01-17T08:00:10.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 68.542157ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
15652025-01-17T08:00:10.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 30.452996ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
15662025-01-17T08:00:10.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 811.47879ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
15672025-01-17T08:00:10.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 56.712722ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
15682025-01-17T08:00:11.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 125.48813ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
15692025-01-17T08:00:11.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 289.795338ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
15702025-01-17T08:00:11.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 1.499928339s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
15712025-01-17T08:00:11.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 523.197159ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
15722025-01-17T08:00:11.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 131.089688ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
15732025-01-17T08:00:11.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.351198963s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
15742025-01-17T08:00:11.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 779.993204ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
15752025-01-17T08:00:11.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 289.261127ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
15762025-01-17T08:00:11.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 802.364584ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
15772025-01-17T08:00:11.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 553.385121ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
15782025-01-17T08:00:11.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 828.281851ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
15792025-01-17T08:00:11.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 562.230618ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
15802025-01-17T08:00:11.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 824.162552ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
15812025-01-17T08:00:11.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.27969607s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
15822025-01-17T08:00:11.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 607.738643ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
15832025-01-17T08:00:11.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 760.215766ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
15842025-01-17T08:00:11.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 774.716421ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
15852025-01-17T08:00:11.603ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 863.161894ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
15862025-01-17T08:00:11.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 623.728898ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
15872025-01-17T08:00:11.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.220016044s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
15882025-01-17T08:00:11.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.236066921s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
15892025-01-17T08:00:11.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 982.530505ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
15902025-01-17T08:00:11.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 934.743229ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
15912025-01-17T08:00:12.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 782.969418ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
15922025-01-17T08:00:12.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 669.620206ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
15932025-01-17T08:00:12.068ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.30259785s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
15942025-01-17T08:00:12.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.306342291s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
15952025-01-17T08:00:12.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 1.263930963s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
15962025-01-17T08:00:12.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 748.493861ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
15972025-01-17T08:00:12.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.379057889s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
15982025-01-17T08:00:12.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 719.783925ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
15992025-01-17T08:00:12.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 1.412366374s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
16002025-01-17T08:00:12.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 1.297232774s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
16012025-01-17T08:00:12.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.109810526s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
16022025-01-17T08:00:12.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 1.190539895s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
16032025-01-17T08:00:12.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.305791462s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
16042025-01-17T08:00:12.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 1.375166184s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
16052025-01-17T08:00:12.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.314599388s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
16062025-01-17T08:00:12.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 922.019419ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
16072025-01-17T08:00:12.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.055389932s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
16082025-01-17T08:00:12.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 542.143737ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
16092025-01-17T08:00:12.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 970.338187ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
16102025-01-17T08:00:12.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 621.478018ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
16112025-01-17T08:00:13.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.372344692s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
16122025-01-17T08:00:13.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 885.443904ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
16132025-01-17T08:00:13.382ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.259315669s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
16142025-01-17T08:00:13.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 588.961188ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
16152025-01-17T08:00:13.464ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 1.129155729s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
16162025-01-17T08:00:13.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 904.682652ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
16172025-01-17T08:00:13.585ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 1.125776498s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
16182025-01-17T08:00:13.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.316532373s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
16192025-01-17T08:00:13.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 621.173444ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
16202025-01-17T08:00:13.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 844.86601ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
16212025-01-17T08:00:13.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 1.197519313s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
16222025-01-17T08:00:13.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 849.292457ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
16232025-01-17T08:00:13.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 1.142699296s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
16242025-01-17T08:00:13.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.316831048s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
16252025-01-17T08:00:13.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.306156109s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
16262025-01-17T08:00:13.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 564.372336ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
16272025-01-17T08:00:13.975ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.187154849s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
16282025-01-17T08:00:14.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 985.522265ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
16292025-01-17T08:00:14.123ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 1.326222272s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
16302025-01-17T08:00:14.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 896.791688ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
16312025-01-17T08:00:14.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.408308828s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
16322025-01-17T08:00:14.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.182174979s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
16332025-01-17T08:00:14.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 622.765861ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
16342025-01-17T08:00:14.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 522.614132ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
16352025-01-17T08:00:14.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 854.630147ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
16362025-01-17T08:00:14.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 1.48764615s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
16372025-01-17T08:00:14.629ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 1.010587705s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
16382025-01-17T08:00:14.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.327190034s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
16392025-01-17T08:00:14.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 1.051563482s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
16402025-01-17T08:00:14.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.441747238s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
16412025-01-17T08:00:14.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 531.152693ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
16422025-01-17T08:00:14.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 1.156654795s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
16432025-01-17T08:00:15.029ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 935.894215ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
16442025-01-17T08:00:15.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 941.977728ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
16452025-01-17T08:00:15.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 503.892859ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
16462025-01-17T08:00:15.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 895.83778ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
16472025-01-17T08:00:15.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.251693602s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
16482025-01-17T08:00:15.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.378736431s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
16492025-01-17T08:00:15.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 566.239588ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
16502025-01-17T08:00:15.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.444390588s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
16512025-01-17T08:00:15.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 1.097334204s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
16522025-01-17T08:00:15.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 697.372552ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
16532025-01-17T08:00:15.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 980.000963ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
16542025-01-17T08:00:15.600ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 824.701493ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
16552025-01-17T08:00:15.668ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16562025-01-17T08:00:15.668ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
16572025-01-17T08:00:15.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 556.154911ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
16582025-01-17T08:00:15.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.07496581s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
16592025-01-17T08:00:15.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 948.340074ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
16602025-01-17T08:00:15.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.47978957s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
16612025-01-17T08:00:15.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 25.866807ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
16622025-01-17T08:00:15.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 148.737313ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
16632025-01-17T08:00:15.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 1.265235058s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
16642025-01-17T08:00:15.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 865.035871ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
16652025-01-17T08:00:15.989ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 560.144805ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
16662025-01-17T08:00:15.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 791.705603ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
16672025-01-17T08:00:16.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 118.018447ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
16682025-01-17T08:00:16.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 1.145736509s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
16692025-01-17T08:00:16.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 978.627604ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
16702025-01-17T08:00:16.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 999.581622ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
16712025-01-17T08:00:16.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 447.59557ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
16722025-01-17T08:00:16.244ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 1.4023468s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
16732025-01-17T08:00:16.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 614.570095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
16742025-01-17T08:00:16.433ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.32243235s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
16752025-01-17T08:00:16.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 744.629832ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
16762025-01-17T08:00:16.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.351254771s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
16772025-01-17T08:00:16.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 573.707965ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
16782025-01-17T08:00:16.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 1.398017315s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
16792025-01-17T08:00:16.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 658.620307ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
16802025-01-17T08:00:16.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 924.086059ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
16812025-01-17T08:00:16.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 926.565052ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
16822025-01-17T08:00:16.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 983.624738ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
16832025-01-17T08:00:16.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 872.022515ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
16842025-01-17T08:00:16.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 1.370544031s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
16852025-01-17T08:00:16.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 944.951464ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
16862025-01-17T08:00:16.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.056027198s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
16872025-01-17T08:00:17.117ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 636.779619ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
16882025-01-17T08:00:17.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.228005954s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
16892025-01-17T08:00:17.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 1.026627285s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
16902025-01-17T08:00:17.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.079123563s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
16912025-01-17T08:00:17.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 1.009032036s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
16922025-01-17T08:00:17.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 910.816441ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
16932025-01-17T08:00:17.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 951.668136ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
16942025-01-17T08:00:17.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.499418639s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
16952025-01-17T08:00:17.369ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52537
16962025-01-17T08:00:17.389ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1994 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52537 req_id = 4869c09f-129f-4841-a668-7054dd54dee2 response_code = 200 uri = /baseboard
16972025-01-17T08:00:17.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 1.310812554s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
16982025-01-17T08:00:17.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 1.328532047s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
16992025-01-17T08:00:17.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 719.298552ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
17002025-01-17T08:00:17.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.209312031s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
17012025-01-17T08:00:17.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 739.808461ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
17022025-01-17T08:00:17.771ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 926.474945ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
17032025-01-17T08:00:17.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.176279365s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
17042025-01-17T08:00:17.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 892.168849ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
17052025-01-17T08:00:17.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.363842332s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
17062025-01-17T08:00:17.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 669.348392ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
17072025-01-17T08:00:18.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 853.502031ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
17082025-01-17T08:00:18.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 1.465203615s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
17092025-01-17T08:00:18.226ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 810.089944ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
17102025-01-17T08:00:18.238ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 1.435277698s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
17112025-01-17T08:00:18.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 733.562259ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
17122025-01-17T08:00:18.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 1.482409058s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
17132025-01-17T08:00:18.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 762.347043ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
17142025-01-17T08:00:18.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.435152552s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
17152025-01-17T08:00:18.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 546.105644ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
17162025-01-17T08:00:18.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 1.145909531s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
17172025-01-17T08:00:18.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 674.054365ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
17182025-01-17T08:00:18.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.06340978s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
17192025-01-17T08:00:18.778ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.149134396s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
17202025-01-17T08:00:18.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.077669034s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
17212025-01-17T08:00:18.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 543.600699ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
17222025-01-17T08:00:18.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 546.781381ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
17232025-01-17T08:00:18.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 816.730222ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
17242025-01-17T08:00:18.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 699.050519ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
17252025-01-17T08:00:18.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.079428613s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
17262025-01-17T08:00:18.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 757.105395ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
17272025-01-17T08:00:19.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 701.210946ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
17282025-01-17T08:00:19.049ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 526.457584ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
17292025-01-17T08:00:19.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 914.829732ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
17302025-01-17T08:00:19.296ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.444223416s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
17312025-01-17T08:00:19.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 727.969149ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
17322025-01-17T08:00:19.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 1.490372549s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
17332025-01-17T08:00:19.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.462219274s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
17342025-01-17T08:00:19.591ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 875.616506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
17352025-01-17T08:00:19.659ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 1.202823266s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
17362025-01-17T08:00:19.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 789.800316ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
17372025-01-17T08:00:19.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 572.391061ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
17382025-01-17T08:00:19.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 1.378684343s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
17392025-01-17T08:00:19.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 756.311877ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
17402025-01-17T08:00:19.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.180098297s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
17412025-01-17T08:00:19.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 975.160625ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
17422025-01-17T08:00:19.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 522.751264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
17432025-01-17T08:00:19.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 715.428458ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
17442025-01-17T08:00:19.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 687.676781ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
17452025-01-17T08:00:19.904ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 575.42137ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
17462025-01-17T08:00:19.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.385956846s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
17472025-01-17T08:00:19.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.064875005s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
17482025-01-17T08:00:20.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 836.676339ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
17492025-01-17T08:00:20.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 575.74292ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
17502025-01-17T08:00:20.238ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.273483852s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
17512025-01-17T08:00:20.278ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 952.622829ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
17522025-01-17T08:00:20.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.335376729s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
17532025-01-17T08:00:20.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 538.238942ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
17542025-01-17T08:00:20.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 935.771244ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
17552025-01-17T08:00:20.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 866.618406ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
17562025-01-17T08:00:20.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 892.735584ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
17572025-01-17T08:00:20.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.33003282s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
17582025-01-17T08:00:20.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.130801029s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
17592025-01-17T08:00:20.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 573.682539ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
17602025-01-17T08:00:20.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.251121599s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
17612025-01-17T08:00:20.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 528.357495ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
17622025-01-17T08:00:20.879ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 535.198702ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
17632025-01-17T08:00:20.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.20873024s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
17642025-01-17T08:00:20.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 506.475624ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
17652025-01-17T08:00:20.976ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.213237904s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
17662025-01-17T08:00:20.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 1.004257805s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
17672025-01-17T08:00:21.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 1.311453256s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
17682025-01-17T08:00:21.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 654.993673ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
17692025-01-17T08:00:21.099ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 1.21699907s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
17702025-01-17T08:00:21.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 1.025007627s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
17712025-01-17T08:00:21.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 586.685118ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
17722025-01-17T08:00:21.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 1.224031567s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
17732025-01-17T08:00:21.345ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 627.667755ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
17742025-01-17T08:00:21.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.159410994s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
17752025-01-17T08:00:21.429ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 790.410978ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
17762025-01-17T08:00:21.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 842.316642ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
17772025-01-17T08:00:21.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 1.400184127s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
17782025-01-17T08:00:21.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 826.793246ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
17792025-01-17T08:00:21.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 648.709661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
17802025-01-17T08:00:21.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.445634655s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
17812025-01-17T08:00:21.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 998.13723ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
17822025-01-17T08:00:21.877ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 1.280789073s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
17832025-01-17T08:00:21.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 906.94651ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
17842025-01-17T08:00:21.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 857.444506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
17852025-01-17T08:00:22.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 1.070502858s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
17862025-01-17T08:00:22.021ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.264067323s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
17872025-01-17T08:00:22.147ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.486490976s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
17882025-01-17T08:00:22.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 981.143888ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
17892025-01-17T08:00:22.234ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 1.032791248s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
17902025-01-17T08:00:22.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 875.488181ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
17912025-01-17T08:00:22.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 1.308115828s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
17922025-01-17T08:00:22.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.097632752s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
17932025-01-17T08:00:22.331ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 580.263199ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
17942025-01-17T08:00:22.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.169054812s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
17952025-01-17T08:00:22.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 625.353967ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
17962025-01-17T08:00:22.550ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 1.470192225s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
17972025-01-17T08:00:22.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.446065106s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
17982025-01-17T08:00:22.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 798.176092ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
17992025-01-17T08:00:22.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 1.391327825s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
18002025-01-17T08:00:22.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.149517279s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
18012025-01-17T08:00:22.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 1.001480789s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
18022025-01-17T08:00:22.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 727.695607ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
18032025-01-17T08:00:23.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 500.934165ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
18042025-01-17T08:00:23.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 796.55439ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
18052025-01-17T08:00:23.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.389609865s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
18062025-01-17T08:00:23.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3") failed: Property not found. retry in 1.474381231s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
18072025-01-17T08:00:23.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 868.886536ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
18082025-01-17T08:00:23.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.036412901s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
18092025-01-17T08:00:23.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 1.106071764s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
18102025-01-17T08:00:23.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.351752138s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
18112025-01-17T08:00:23.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.011503705s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
18122025-01-17T08:00:23.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 525.636551ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
18132025-01-17T08:00:23.537ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.26672314s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
18142025-01-17T08:00:23.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 816.107761ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
18152025-01-17T08:00:23.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 618.60229ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
18162025-01-17T08:00:23.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.335204858s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
18172025-01-17T08:00:23.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 692.440052ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
18182025-01-17T08:00:23.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 552.827422ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
18192025-01-17T08:00:23.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 1.039741658s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
18202025-01-17T08:00:24.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b") failed: Property not found. retry in 1.3576316s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
18212025-01-17T08:00:24.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 868.653503ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
18222025-01-17T08:00:24.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 856.359382ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
18232025-01-17T08:00:24.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 597.097838ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
18242025-01-17T08:00:24.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 833.135425ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
18252025-01-17T08:00:24.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 569.476484ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
18262025-01-17T08:00:24.249ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 553.955722ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
18272025-01-17T08:00:24.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 851.584696ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
18282025-01-17T08:00:24.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 683.696792ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
18292025-01-17T08:00:24.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 1.327611653s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
18302025-01-17T08:00:24.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.049057732s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
18312025-01-17T08:00:24.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 607.880588ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
18322025-01-17T08:00:24.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 622.515968ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
18332025-01-17T08:00:24.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.165636416s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
18342025-01-17T08:00:24.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506") failed: Property not found. retry in 1.263332313s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
18352025-01-17T08:00:24.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7") failed: Property not found. retry in 1.000613312s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
18362025-01-17T08:00:24.796ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d") failed: Property not found. retry in 623.254441ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
18372025-01-17T08:00:24.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d") failed: Property not found. retry in 1.155368306s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
18382025-01-17T08:00:24.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e") failed: Property not found. retry in 1.133343019s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
18392025-01-17T08:00:24.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047") failed: Property not found. retry in 1.495344053s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
18402025-01-17T08:00:24.933ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 504.460883ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
18412025-01-17T08:00:24.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14") failed: Property not found. retry in 1.205947872s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
18422025-01-17T08:00:24.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 1.26498777s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
18432025-01-17T08:00:24.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef") failed: Property not found. retry in 1.427018067s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
18442025-01-17T08:00:25.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0") failed: Property not found. retry in 1.153475469s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
18452025-01-17T08:00:25.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 793.098378ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
18462025-01-17T08:00:25.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c") failed: Property not found. retry in 1.131921836s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
18472025-01-17T08:00:25.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 1.117077463s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
18482025-01-17T08:00:25.446ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442") failed: Property not found. retry in 1.327975855s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
18492025-01-17T08:00:25.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19") failed: Property not found. retry in 1.445765913s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
18502025-01-17T08:00:25.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077") failed: Property not found. retry in 1.204043839s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
18512025-01-17T08:00:25.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2") failed: Property not found. retry in 1.132179957s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
18522025-01-17T08:00:25.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993") failed: Property not found. retry in 1.179476587s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
18532025-01-17T08:00:26.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff") failed: Property not found. retry in 1.235031515s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
18542025-01-17T08:00:26.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68") failed: Property not found. retry in 1.193773417s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
18552025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_7091f564-4da9-4862-bb09-767c6ad5168d
18562025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_77fdb2fd-00ad-4d10-91e0-bc5591029bb2
18572025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_d794aa3a-5dab-4875-b71d-e5a1e234bc7b
18582025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_ad41be94-88ad-4307-80f1-01815ba4aac3
18592025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_3a7d06b4-6a4a-4656-9993-8071e5a7d047
18602025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_f7a5f59c-ecf5-4182-a00a-5f7007447442
18612025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_9182b5db-6831-43c9-bb90-36b92e1f25ff
18622025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_05096a81-cfc4-4fb8-9f3a-c20e46f0ff1e
18632025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_101f6616-5329-4eab-a4f7-4de836bd812d
18642025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_795d94b5-1279-4d33-bb2a-72d7e9f02077
18652025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef
18662025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_46d20049-cc6b-49c9-910e-b68eff5badc7
18672025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_2a034e2d-ed46-4215-a595-c73dfd705f68
18682025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_071a6992-9a1e-4c51-bafb-8b6c6292fd19
18692025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_9fdfb25c-9743-4dd7-a951-58d87b8feb7c
18702025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_ce7da4c6-91bd-4f10-ba11-37b190e02d14
18712025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_e67e6aa6-2a95-43c5-b570-c597a1f61506
18722025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_2555c8f0-c6a3-4ad4-9096-1e3c080f27a0
18732025-01-17T08:00:27.549ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_dfe7a708-acf2-4323-87e2-04f8d0dbb993
18742025-01-17T08:00:27.553ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18752025-01-17T08:00:27.558ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
18762025-01-17T08:00:27.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42931897 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:45267 req_id = ae55af61-24de-4f6e-9c03-0767169c4827 response_code = 204 uri = /omicron-zones
18772025-01-17T08:00:27.579ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
18782025-01-17T08:00:27.598ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
18792025-01-17T08:00:27.601ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:803
18802025-01-17T08:00:27.657ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
18812025-01-17T08:00:29.936ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18822025-01-17T08:00:29.938ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 8.39448124s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
18832025-01-17T08:00:30.020ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18842025-01-17T08:00:30.119ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18852025-01-17T08:00:30.245ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18862025-01-17T08:00:30.412ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18872025-01-17T08:00:30.604ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18882025-01-17T08:00:30.756ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18892025-01-17T08:00:30.998ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18902025-01-17T08:00:31.364ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18912025-01-17T08:00:31.654ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18922025-01-17T08:00:32.094ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18932025-01-17T08:00:32.618ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18942025-01-17T08:00:33.184ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18952025-01-17T08:00:34.507ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/45b632ae-1604-4734-a925-33119227b8d8/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
18962025-01-17T08:00:35.776ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "23db68b3-6918-46bc-bca9-6e8d7bedf198", "content-length": "173", "date": "Fri, 17 Jan 2025 08:00:35 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"45b632ae-1604-4734-a925-33119227b8d8\"", request_id: "23db68b3-6918-46bc-bca9-6e8d7bedf198" } file = sled-agent/src/rack_setup/service.rs:1079
18972025-01-17T08:00:38.198ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "509019bd-81bc-4771-a018-22e6fa8f1076", "content-length": "173", "date": "Fri, 17 Jan 2025 08:00:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d7936c62-666e-4e9a-9d0d-121ba64013ad\"", request_id: "509019bd-81bc-4771-a018-22e6fa8f1076" } file = sled-agent/src/rack_setup/service.rs:1079
18982025-01-17T08:00:40.646ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f67642fa-bb6f-49b8-a4f9-c2a2dc8a11de", "content-length": "173", "date": "Fri, 17 Jan 2025 08:00:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d7936c62-666e-4e9a-9d0d-121ba64013ad\"", request_id: "f67642fa-bb6f-49b8-a4f9-c2a2dc8a11de" } file = sled-agent/src/rack_setup/service.rs:1079
18992025-01-17T08:00:43.681ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b8e337c6-a72a-4120-aa1b-e655681e80d2", "content-length": "173", "date": "Fri, 17 Jan 2025 08:00:43 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d7936c62-666e-4e9a-9d0d-121ba64013ad\"", request_id: "b8e337c6-a72a-4120-aa1b-e655681e80d2" } file = sled-agent/src/rack_setup/service.rs:1079
19002025-01-17T08:00:46.430ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "ee1d8e61-46d9-4d67-b457-b953b0ee241c", "content-length": "173", "date": "Fri, 17 Jan 2025 08:00:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d7936c62-666e-4e9a-9d0d-121ba64013ad\"", request_id: "ee1d8e61-46d9-4d67-b457-b953b0ee241c" } file = sled-agent/src/rack_setup/service.rs:1079
19012025-01-17T08:00:47.426ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38911
19022025-01-17T08:00:47.427ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38911 req_id = 36d96ca7-a5ce-40ce-9900-d63ae84b0724 response_code = 200 uri = /baseboard
19032025-01-17T08:00:50.303ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "69389f41-0202-4d80-9cad-ba5823e799af", "content-length": "173", "date": "Fri, 17 Jan 2025 08:00:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d7936c62-666e-4e9a-9d0d-121ba64013ad\"", request_id: "69389f41-0202-4d80-9cad-ba5823e799af" } file = sled-agent/src/rack_setup/service.rs:1079
19042025-01-17T08:00:53.144ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "118d2a30-3222-403b-98b4-6dbf316f2471", "content-length": "173", "date": "Fri, 17 Jan 2025 08:00:53 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d7936c62-666e-4e9a-9d0d-121ba64013ad\"", request_id: "118d2a30-3222-403b-98b4-6dbf316f2471" } file = sled-agent/src/rack_setup/service.rs:1079
19052025-01-17T08:00:57.744ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "73e83b6b-feb9-412f-be0f-9377ee9f52b0", "content-length": "173", "date": "Fri, 17 Jan 2025 08:00:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d7936c62-666e-4e9a-9d0d-121ba64013ad\"", request_id: "73e83b6b-feb9-412f-be0f-9377ee9f52b0" } file = sled-agent/src/rack_setup/service.rs:1079
19062025-01-17T08:01:00.863ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b7b3aee4-b9a4-4153-9a6a-286c756c9245", "content-length": "173", "date": "Fri, 17 Jan 2025 08:01:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d7936c62-666e-4e9a-9d0d-121ba64013ad\"", request_id: "b7b3aee4-b9a4-4153-9a6a-286c756c9245" } file = sled-agent/src/rack_setup/service.rs:1079
19072025-01-17T08:01:08.693ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cc6874d5-037e-4321-a99a-032c3689a503", "content-length": "173", "date": "Fri, 17 Jan 2025 08:01:08 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"d7936c62-666e-4e9a-9d0d-121ba64013ad\"", request_id: "cc6874d5-037e-4321-a99a-032c3689a503" } file = sled-agent/src/rack_setup/service.rs:1079
19082025-01-17T08:01:14.674ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
19092025-01-17T08:01:14.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49554
19102025-01-17T08:01:14.768ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19112025-01-17T08:01:14.769ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19122025-01-17T08:01:14.769ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
19132025-01-17T08:01:14.772ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
19142025-01-17T08:01:14.785ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19152025-01-17T08:01:14.785ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9813f791-8da3-471c-9021-42fd85d77240
19162025-01-17T08:01:14.806ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19172025-01-17T08:01:14.806ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_03539269-b412-4961-92af-cf162b13a30f
19182025-01-17T08:01:14.827ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19192025-01-17T08:01:14.827ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256
19202025-01-17T08:01:14.846ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19212025-01-17T08:01:14.846ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5
19222025-01-17T08:01:14.867ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19232025-01-17T08:01:14.868ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_11fc8969-6569-4e63-b863-6b5f04571d1f
19242025-01-17T08:01:14.887ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19252025-01-17T08:01:14.887ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb743880-ceb4-4309-9fe1-855954a7a059
19262025-01-17T08:01:14.907ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19272025-01-17T08:01:14.907ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24cecd51-2313-4198-99e2-aa6943e55b03
19282025-01-17T08:01:14.927ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19292025-01-17T08:01:14.927ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf
19302025-01-17T08:01:14.946ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19312025-01-17T08:01:14.946ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22491af9-677c-492c-b09f-dd32d6d37612
19322025-01-17T08:01:14.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193686 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49554 req_id = 30920342-1278-4340-a83f-0723750ef926 response_code = 200 uri = /inventory
19332025-01-17T08:01:17.460ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36532
19342025-01-17T08:01:17.460ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36532 req_id = 16b9aea6-9bf7-41fd-8ebe-391c33b0bd0a response_code = 200 uri = /baseboard
19352025-01-17T08:01:19.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38042
19362025-01-17T08:01:19.843ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19372025-01-17T08:01:19.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19382025-01-17T08:01:19.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19392025-01-17T08:01:19.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19402025-01-17T08:01:19.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19412025-01-17T08:01:19.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19422025-01-17T08:01:19.843ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19432025-01-17T08:01:19.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5883 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38042 req_id = ad6b7fec-321f-4dfc-a45b-3147cd7d1d1e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19442025-01-17T08:01:19.844ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
19452025-01-17T08:01:19.848ZINFOSledAgent (RSS): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19462025-01-17T08:01:19.848ZINFOSledAgent (RSS): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19472025-01-17T08:01:20.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39510
19482025-01-17T08:01:20.102ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19492025-01-17T08:01:20.102ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
19502025-01-17T08:01:20.102ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
19512025-01-17T08:01:20.102ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
19522025-01-17T08:01:20.114ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19532025-01-17T08:01:20.114ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9813f791-8da3-471c-9021-42fd85d77240
19542025-01-17T08:01:20.141ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19552025-01-17T08:01:20.141ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_03539269-b412-4961-92af-cf162b13a30f
19562025-01-17T08:01:20.164ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19572025-01-17T08:01:20.164ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256
19582025-01-17T08:01:20.184ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19592025-01-17T08:01:20.184ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5
19602025-01-17T08:01:20.207ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19612025-01-17T08:01:20.207ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_11fc8969-6569-4e63-b863-6b5f04571d1f
19622025-01-17T08:01:20.230ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19632025-01-17T08:01:20.230ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb743880-ceb4-4309-9fe1-855954a7a059
19642025-01-17T08:01:20.256ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19652025-01-17T08:01:20.256ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24cecd51-2313-4198-99e2-aa6943e55b03
19662025-01-17T08:01:20.276ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19672025-01-17T08:01:20.276ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf
19682025-01-17T08:01:20.295ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
19692025-01-17T08:01:20.295ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22491af9-677c-492c-b09f-dd32d6d37612
19702025-01-17T08:01:20.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206765 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39510 req_id = 15717f96-d766-437a-af43-b0906d1c0f57 response_code = 200 uri = /inventory
19712025-01-17T08:01:20.378ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47976
19722025-01-17T08:01:20.378ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19732025-01-17T08:01:20.378ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19742025-01-17T08:01:20.378ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19752025-01-17T08:01:20.378ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19762025-01-17T08:01:20.378ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19772025-01-17T08:01:20.378ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19782025-01-17T08:01:20.378ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19792025-01-17T08:01:20.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47976 req_id = ef06705b-5725-49df-af6b-7faa8bc3dc00 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19802025-01-17T08:01:21.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38562
19812025-01-17T08:01:21.225ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19822025-01-17T08:01:21.225ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19832025-01-17T08:01:21.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19842025-01-17T08:01:21.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19852025-01-17T08:01:21.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19862025-01-17T08:01:21.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19872025-01-17T08:01:21.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19882025-01-17T08:01:21.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 321 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38562 req_id = d15b205f-055c-49b4-8e51-5d02c151e514 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19892025-01-17T08:01:21.750ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:48080 remote_addr = [fd00:1122:3344:101::d]:44914 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
19902025-01-17T08:01:21.785ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33881 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = fe228d9e-3ed4-4067-8127-b96ae0677216 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
19912025-01-17T08:01:21.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47945
19922025-01-17T08:01:21.791ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19932025-01-17T08:01:21.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19942025-01-17T08:01:21.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19952025-01-17T08:01:21.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19962025-01-17T08:01:21.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19972025-01-17T08:01:21.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19982025-01-17T08:01:21.791ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19992025-01-17T08:01:21.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47945 req_id = 5626df3a-3a2c-44ea-aa95-10dd03bab0d4 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20002025-01-17T08:01:26.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36337
20012025-01-17T08:01:26.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36337 req_id = 1cfb6396-7faa-4319-9f59-ae03c9e21f36 response_code = 200 uri = /vpc-routes
20022025-01-17T08:01:26.188ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
20032025-01-17T08:01:26.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36337 req_id = ab1e822f-0f1d-4fdc-8b11-01ac8dd6ca7e response_code = 204 uri = /eip-gateways
20042025-01-17T08:01:26.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36337 req_id = 6dc31b5d-8a76-4e93-92f0-23963fad1c6c response_code = 204 uri = /vpc-routes
20052025-01-17T08:01:36.784ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34501
20062025-01-17T08:01:36.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34501 req_id = b67c1f13-1948-4a51-b945-75633538ad63 response_code = 200 uri = /vpc-routes
20072025-01-17T08:01:36.894ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
20082025-01-17T08:01:36.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34501 req_id = 7cf04274-9d91-4c45-8d3e-9ebb10cc9b70 response_code = 204 uri = /eip-gateways
20092025-01-17T08:01:36.909ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34501 req_id = b81217a1-f335-479a-9e47-c3399fe6f12b response_code = 204 uri = /vpc-routes
20102025-01-17T08:01:36.930ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48552
20112025-01-17T08:01:36.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48552 req_id = ee521824-813a-4757-8496-a9ddb55f52af response_code = 200 uri = /vpc-routes
20122025-01-17T08:01:37.111ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
20132025-01-17T08:01:37.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48552 req_id = 799628f0-dc68-49c6-b498-14b525bf98ef response_code = 204 uri = /eip-gateways
20142025-01-17T08:01:37.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55719
20152025-01-17T08:01:37.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 953 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55719 req_id = 0935996b-cb02-4835-81f2-e3a97f19c071 response_code = 200 uri = /v2p
20162025-01-17T08:01:37.164ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62573
20172025-01-17T08:01:37.165ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62573 req_id = ccb6cbdd-dd9f-4343-9911-deda5dc0d31a response_code = 200 uri = /v2p
20182025-01-17T08:01:37.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58690
20192025-01-17T08:01:37.215ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20202025-01-17T08:01:37.290ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20212025-01-17T08:01:37.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146760 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58690 req_id = b9d4ab6e-26f7-422f-ba52-66edb8349bf2 response_code = 204 uri = /switch-ports
20222025-01-17T08:01:37.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48865
20232025-01-17T08:01:37.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33337
20242025-01-17T08:01:37.361ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20252025-01-17T08:01:37.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7096 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33337 req_id = da24aa60-f8aa-49ed-9b37-7759981c6eb5 response_code = 200 uri = /vpc-routes
20262025-01-17T08:01:37.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7404 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48552 req_id = e6aa858d-2418-49f6-a0a9-81b62e9302b8 response_code = 204 uri = /vpc-routes
20272025-01-17T08:01:37.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 12806 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58690 req_id = 33c0d7ab-c952-4837-8f89-c094db905ebc response_code = 200 uri = /network-bootstore-config
20282025-01-17T08:01:37.420ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20292025-01-17T08:01:37.420ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
20302025-01-17T08:01:37.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3901 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33337 req_id = 022b2864-08f9-4811-a4ed-f2ac98ec235e response_code = 204 uri = /eip-gateways
20312025-01-17T08:01:37.468ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44526
20322025-01-17T08:01:37.468ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44526 req_id = 80964bf4-575b-4504-aaa1-a1a51b771812 response_code = 200 uri = /v2p
20332025-01-17T08:01:37.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 841 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33337 req_id = 868e761e-9438-402e-a73a-56cf131d12c4 response_code = 204 uri = /vpc-routes
20342025-01-17T08:01:37.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123792 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48865 req_id = 06905543-b3f7-4675-855b-5f5874363fcb response_code = 204 uri = /switch-ports
20352025-01-17T08:01:37.485ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48865 req_id = 08145f14-d19f-48b3-9c7d-cafe22e5019d response_code = 200 uri = /network-bootstore-config
20362025-01-17T08:01:37.492ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
20372025-01-17T08:01:37.492ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20382025-01-17T08:01:37.494ZINFOSledAgent (bootstore): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20392025-01-17T08:01:37.495ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
20402025-01-17T08:01:37.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4956 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58690 req_id = 66618e3c-4dd8-453e-989e-b1d889a696d9 response_code = 204 uri = /network-bootstore-config
20412025-01-17T08:01:37.536ZINFOSledAgent (bootstore): Attempting to update network config with generation: 3, current_generation: 2 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
20422025-01-17T08:01:37.536ZINFOSledAgent (bootstore): Writing ledger to /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20432025-01-17T08:01:37.536ZINFOSledAgent (bootstore): Writing ledger to /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20442025-01-17T08:01:37.536ZINFOSledAgent (bootstore): Broadcasting network config with generation 3 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
20452025-01-17T08:01:37.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 477 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48865 req_id = 3393f826-3a30-4609-a7e4-2a029c107ce9 response_code = 204 uri = /network-bootstore-config
20462025-01-17T08:01:37.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38342
20472025-01-17T08:01:37.643ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20482025-01-17T08:01:37.683ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20492025-01-17T08:01:37.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94216 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38342 req_id = fb129a33-87f0-4391-9228-95ef49f1e351 response_code = 204 uri = /switch-ports
20502025-01-17T08:01:37.738ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38342 req_id = 05b68b6d-c010-48ab-85c1-7fca0e56c4c5 response_code = 200 uri = /network-bootstore-config
20512025-01-17T08:01:47.493ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60381
20522025-01-17T08:01:47.493ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60381 req_id = bc16bc5c-c0c1-48be-9064-6724b5d5f3d3 response_code = 200 uri = /baseboard
20532025-01-17T08:01:51.757ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7190 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 123c35af-76bc-4089-a849-8cd879f9f26c response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
20542025-01-17T08:02:06.573ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54959
20552025-01-17T08:02:06.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54959 req_id = cd4c1ed1-366c-490f-a2a5-055fea681891 response_code = 200 uri = /vpc-routes
20562025-01-17T08:02:06.669ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
20572025-01-17T08:02:06.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54959 req_id = 2a8b0108-8d6a-4997-908c-c5e86442296d response_code = 204 uri = /eip-gateways
20582025-01-17T08:02:06.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54959 req_id = f9c33d1d-442b-489c-9218-bd71bff61573 response_code = 204 uri = /vpc-routes
20592025-01-17T08:02:06.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34612
20602025-01-17T08:02:06.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34612 req_id = 9d08dee6-bac8-4643-afe5-763f9eb8ef94 response_code = 200 uri = /vpc-routes
20612025-01-17T08:02:06.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60330
20622025-01-17T08:02:06.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60330 req_id = 917ec4f4-a349-4586-979a-5df141a572b0 response_code = 200 uri = /v2p
20632025-01-17T08:02:06.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57141
20642025-01-17T08:02:06.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57141 req_id = d216ae84-3f16-47c2-8b8c-0349d8babbb6 response_code = 200 uri = /v2p
20652025-01-17T08:02:06.907ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
20662025-01-17T08:02:06.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34612 req_id = a0d2e103-d009-4071-9925-a54d0f29735e response_code = 204 uri = /eip-gateways
20672025-01-17T08:02:06.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34612 req_id = 1b69718a-bff6-48d0-8fd2-65887b40671c response_code = 204 uri = /vpc-routes
20682025-01-17T08:02:06.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32958
20692025-01-17T08:02:06.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20702025-01-17T08:02:06.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20712025-01-17T08:02:07.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105079 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:32958 req_id = 8ad6c1eb-343c-4dd9-90fa-cb8ee08b623b response_code = 204 uri = /switch-ports
20722025-01-17T08:02:07.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32919
20732025-01-17T08:02:07.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34180
20742025-01-17T08:02:07.040ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41937
20752025-01-17T08:02:07.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32958 req_id = e74e2aca-8c90-4216-806b-d37735839e4f response_code = 200 uri = /network-bootstore-config
20762025-01-17T08:02:07.040ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20772025-01-17T08:02:07.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4464 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34180 req_id = d3691d25-10b2-40ca-9c0b-47f7400c6d74 response_code = 200 uri = /v2p
20782025-01-17T08:02:07.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5329 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32919 req_id = 1c9c475e-661f-422a-b6c3-484a91a573f8 response_code = 200 uri = /vpc-routes
20792025-01-17T08:02:07.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63204
20802025-01-17T08:02:07.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20812025-01-17T08:02:07.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
20822025-01-17T08:02:07.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32919 req_id = 04b48fb5-182d-4fde-9ae8-8f4f45a2ee66 response_code = 204 uri = /eip-gateways
20832025-01-17T08:02:07.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 642 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:32919 req_id = dd1d1c64-fb70-4342-88a2-a7d243330e19 response_code = 204 uri = /vpc-routes
20842025-01-17T08:02:07.134ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20852025-01-17T08:02:07.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93669 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41937 req_id = 71fd933d-76df-45ea-8a7d-f04082425a07 response_code = 204 uri = /switch-ports
20862025-01-17T08:02:07.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 747 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41937 req_id = ad23e5a3-6f83-4ff8-91ea-7b0912704bb0 response_code = 200 uri = /network-bootstore-config
20872025-01-17T08:02:07.168ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20882025-01-17T08:02:07.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148066 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63204 req_id = cf048065-4f62-4470-b6cd-c050a4c087c0 response_code = 204 uri = /switch-ports
20892025-01-17T08:02:07.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63204 req_id = e964ffe6-709f-4d41-b329-b8ed3ad5c0cf response_code = 200 uri = /network-bootstore-config
20902025-01-17T08:02:17.547ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43517
20912025-01-17T08:02:17.548ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43517 req_id = 2d7588e0-f874-4404-89cd-46127f47d7e5 response_code = 200 uri = /baseboard
20922025-01-17T08:02:21.757ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6821 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = e15264f6-f575-4149-85a5-79c7258ab554 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
20932025-01-17T08:02:36.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58558
20942025-01-17T08:02:36.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58558 req_id = 20829d08-bf12-4e27-b54c-813c57a45142 response_code = 200 uri = /vpc-routes
20952025-01-17T08:02:36.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50479
20962025-01-17T08:02:36.883ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50479 req_id = 64ca0ced-c048-4ac5-8216-04a3ae28c91a response_code = 200 uri = /vpc-routes
20972025-01-17T08:02:36.974ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
20982025-01-17T08:02:36.974ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50479 req_id = 1b1fadd3-b153-4b8b-9ab3-c7d766a4a531 response_code = 204 uri = /eip-gateways
20992025-01-17T08:02:36.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50479 req_id = 240d1cfe-c8f0-4615-bdbc-266f605185ba response_code = 204 uri = /vpc-routes
21002025-01-17T08:02:37.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41397
21012025-01-17T08:02:37.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41397 req_id = 6db6111a-e1ef-47e0-a38a-28e667400192 response_code = 200 uri = /vpc-routes
21022025-01-17T08:02:37.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33033
21032025-01-17T08:02:37.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33033 req_id = d407c1e5-4209-4d22-ac5c-a929984ecf70 response_code = 200 uri = /v2p
21042025-01-17T08:02:37.078ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
21052025-01-17T08:02:37.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41397 req_id = 19832c9b-af7f-49ce-868d-8344841fabfd response_code = 204 uri = /eip-gateways
21062025-01-17T08:02:37.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40119
21072025-01-17T08:02:37.084ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21082025-01-17T08:02:37.124ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21092025-01-17T08:02:37.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95781 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40119 req_id = 26ae38fb-6256-44c3-aebd-4d1bb2a6d02c response_code = 204 uri = /switch-ports
21102025-01-17T08:02:37.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36018
21112025-01-17T08:02:37.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44950
21122025-01-17T08:02:37.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57365
21132025-01-17T08:02:37.181ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
21142025-01-17T08:02:37.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58558 req_id = 5e60946e-6fec-4dbc-8788-c9a8f3055be3 response_code = 204 uri = /eip-gateways
21152025-01-17T08:02:37.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21162025-01-17T08:02:37.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 658 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41397 req_id = 785d6047-515c-448a-820f-abb80695f904 response_code = 204 uri = /vpc-routes
21172025-01-17T08:02:37.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44950 req_id = a3631c86-b0aa-4acd-92b0-8d550721cd60 response_code = 200 uri = /v2p
21182025-01-17T08:02:37.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40119 req_id = 02992254-2767-42d1-9deb-12a12f7601b1 response_code = 200 uri = /network-bootstore-config
21192025-01-17T08:02:37.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36018 req_id = cef32204-588a-4b36-b2ce-35f56fcfb69d response_code = 200 uri = /v2p
21202025-01-17T08:02:37.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 443 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58558 req_id = 33bc487d-6064-45e4-97d1-1836d181e01f response_code = 204 uri = /vpc-routes
21212025-01-17T08:02:37.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33136
21222025-01-17T08:02:37.222ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21232025-01-17T08:02:37.279ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21242025-01-17T08:02:37.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97857 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57365 req_id = 93b65c0f-0ec2-4f17-86cc-feb33b221967 response_code = 204 uri = /switch-ports
21252025-01-17T08:02:37.284ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 618 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57365 req_id = 677ebb2b-97a9-4b18-8256-20598d2a7542 response_code = 200 uri = /network-bootstore-config
21262025-01-17T08:02:37.317ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21272025-01-17T08:02:37.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147996 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33136 req_id = 9f4b5a49-56b9-4519-8a5e-63fa8b9273aa response_code = 204 uri = /switch-ports
21282025-01-17T08:02:37.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33136 req_id = 5d76e32e-343e-4edc-a00c-d2f506146b19 response_code = 200 uri = /network-bootstore-config
21292025-01-17T08:02:47.587ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54405
21302025-01-17T08:02:47.587ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54405 req_id = 73846c17-52a4-4960-b9a3-a9779946190e response_code = 200 uri = /baseboard
21312025-01-17T08:02:51.762ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8275 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 21e2ba8f-7b06-4cf1-b0b5-44b272e7aaf4 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
21322025-01-17T08:03:06.721ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48484
21332025-01-17T08:03:06.721ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48484 req_id = f89f5976-6b9c-45c8-be1c-b994ac0b36e1 response_code = 200 uri = /vpc-routes
21342025-01-17T08:03:06.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54700
21352025-01-17T08:03:06.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54700 req_id = ee9ae8fd-2a38-4c05-85fe-5787b8049b3a response_code = 200 uri = /vpc-routes
21362025-01-17T08:03:06.782ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
21372025-01-17T08:03:06.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48484 req_id = 94584aec-cd92-49f1-898a-d4cd824a33f3 response_code = 204 uri = /eip-gateways
21382025-01-17T08:03:06.800ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48484 req_id = f9854644-c4f5-45af-8622-ac321a17ed83 response_code = 204 uri = /vpc-routes
21392025-01-17T08:03:06.814ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
21402025-01-17T08:03:06.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54700 req_id = abd303c4-980f-4372-a2a6-41f5ca797795 response_code = 204 uri = /eip-gateways
21412025-01-17T08:03:06.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54700 req_id = faaa7de5-c170-4072-b346-1b393e4b2d0e response_code = 204 uri = /vpc-routes
21422025-01-17T08:03:06.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52245
21432025-01-17T08:03:06.858ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21442025-01-17T08:03:06.897ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21452025-01-17T08:03:06.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103090 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52245 req_id = 80b79b35-ce5f-474d-bd68-bdfe6024d49c response_code = 204 uri = /switch-ports
21462025-01-17T08:03:06.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59392
21472025-01-17T08:03:06.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35171
21482025-01-17T08:03:06.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52245 req_id = 454c91a5-aa26-4bf4-9639-49fc997bc13f response_code = 200 uri = /network-bootstore-config
21492025-01-17T08:03:06.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35171 req_id = cf7b3f24-cfd5-4782-ba6e-947cd62d7b1a response_code = 200 uri = /vpc-routes
21502025-01-17T08:03:06.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 847 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59392 req_id = a79cfffd-a43f-4e87-bc20-c4d436fdddd9 response_code = 200 uri = /v2p
21512025-01-17T08:03:06.979ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
21522025-01-17T08:03:06.980ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 670 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35171 req_id = ef1fb65c-8737-402d-94ef-711ecc10aab5 response_code = 204 uri = /eip-gateways
21532025-01-17T08:03:06.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49675
21542025-01-17T08:03:06.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49872
21552025-01-17T08:03:06.984ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21562025-01-17T08:03:06.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49872 req_id = be98bd6a-8c50-4170-b7c8-d38a3aa1c23b response_code = 200 uri = /v2p
21572025-01-17T08:03:06.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 396 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35171 req_id = f0d0849a-337b-4157-84e2-19ac70c13dcb response_code = 204 uri = /vpc-routes
21582025-01-17T08:03:07.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38416
21592025-01-17T08:03:07.025ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21602025-01-17T08:03:07.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58505
21612025-01-17T08:03:07.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58505 req_id = 75881b27-50de-49a0-98d0-7054aff1eeb7 response_code = 200 uri = /v2p
21622025-01-17T08:03:07.082ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21632025-01-17T08:03:07.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97915 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49675 req_id = 91a2b69a-52ae-46e3-bd0a-1c9f275fc044 response_code = 204 uri = /switch-ports
21642025-01-17T08:03:07.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 731 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49675 req_id = e562da8a-6293-408b-a23a-32c8732fa1f1 response_code = 200 uri = /network-bootstore-config
21652025-01-17T08:03:07.118ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21662025-01-17T08:03:07.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165127 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:38416 req_id = b5f44f34-9c09-4402-acd1-57ce07af942d response_code = 204 uri = /switch-ports
21672025-01-17T08:03:07.170ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38416 req_id = c1ad1ab1-80c4-46c9-8cfa-e14dc97dc3c2 response_code = 200 uri = /network-bootstore-config
21682025-01-17T08:03:17.621ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48573
21692025-01-17T08:03:17.621ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48573 req_id = f79143c6-859d-480c-a3fb-66a0a50b0094 response_code = 200 uri = /baseboard
21702025-01-17T08:03:21.762ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7419 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 4e635ea4-b8fc-43c2-8c77-8839a7681dfd response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
21712025-01-17T08:03:36.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44925
21722025-01-17T08:03:36.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44925 req_id = 017c2600-a6e8-4984-a110-afe2f29852f9 response_code = 200 uri = /vpc-routes
21732025-01-17T08:03:36.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52360
21742025-01-17T08:03:36.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52360 req_id = 499274f4-f329-4fa7-96a2-a01952552d40 response_code = 200 uri = /vpc-routes
21752025-01-17T08:03:37.000ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
21762025-01-17T08:03:37.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44925 req_id = 8bedf486-ce62-4615-94c4-058ae9f2831b response_code = 204 uri = /eip-gateways
21772025-01-17T08:03:37.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44925 req_id = a9e5a15a-41de-49a1-bb89-97e1136c11fb response_code = 204 uri = /vpc-routes
21782025-01-17T08:03:37.069ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
21792025-01-17T08:03:37.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52360 req_id = 015f84be-9843-4cb5-80fd-fcf76537c5f6 response_code = 204 uri = /eip-gateways
21802025-01-17T08:03:37.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52360 req_id = 498fbee7-76fc-46fc-926d-d1ede69eebe6 response_code = 204 uri = /vpc-routes
21812025-01-17T08:03:37.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56781
21822025-01-17T08:03:37.095ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21832025-01-17T08:03:37.142ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21842025-01-17T08:03:37.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107839 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56781 req_id = 72413ccd-405d-4c95-9ae2-69820aea8a01 response_code = 204 uri = /switch-ports
21852025-01-17T08:03:37.203ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39569
21862025-01-17T08:03:37.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53393
21872025-01-17T08:03:37.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49179
21882025-01-17T08:03:37.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 419 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56781 req_id = 5ab38f2e-c745-4e30-8c8c-cc0d83c962ec response_code = 200 uri = /network-bootstore-config
21892025-01-17T08:03:37.204ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49179 req_id = 48e7a2a0-ab82-43bd-bf4a-a254c4caa12d response_code = 200 uri = /vpc-routes
21902025-01-17T08:03:37.204ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21912025-01-17T08:03:37.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5706 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53393 req_id = 429730a1-4310-4861-a739-2315c37fd3e5 response_code = 200 uri = /v2p
21922025-01-17T08:03:37.216ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62044
21932025-01-17T08:03:37.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62044 req_id = c95d8cba-57b4-421d-b4d2-ac1306c01ff2 response_code = 200 uri = /v2p
21942025-01-17T08:03:37.252ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
21952025-01-17T08:03:37.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49179 req_id = 8cf24d18-b5f0-4b65-82cb-7330c9d74185 response_code = 204 uri = /eip-gateways
21962025-01-17T08:03:37.253ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21972025-01-17T08:03:37.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:49179 req_id = d21ed061-9993-41ef-8af2-ed82efbae4ec response_code = 204 uri = /vpc-routes
21982025-01-17T08:03:37.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63868
21992025-01-17T08:03:37.315ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22002025-01-17T08:03:37.315ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111096 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:39569 req_id = b234ae41-0e37-4a9a-aeb5-03b88b2b37c2 response_code = 204 uri = /switch-ports
22012025-01-17T08:03:37.319ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39569 req_id = b5fa91cb-04c9-48ea-8b76-ae59a3cb0f7d response_code = 200 uri = /network-bootstore-config
22022025-01-17T08:03:37.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46598
22032025-01-17T08:03:37.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46598 req_id = 9aafff94-9aac-476b-964b-7124ed9bbcf7 response_code = 200 uri = /v2p
22042025-01-17T08:03:37.352ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22052025-01-17T08:03:37.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124394 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63868 req_id = 3cec3430-6fb0-4e50-9ba3-8bc74ba1321e response_code = 204 uri = /switch-ports
22062025-01-17T08:03:37.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63868 req_id = 4b35c186-2047-47bf-be4b-890e8b0d768e response_code = 200 uri = /network-bootstore-config
22072025-01-17T08:03:41.588ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
22082025-01-17T08:03:47.650ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57297
22092025-01-17T08:03:47.650ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:57297 req_id = da1dff5b-9c4c-4ef3-942c-6c280daddcec response_code = 200 uri = /baseboard
22102025-01-17T08:03:51.757ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6604 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 519db04d-e872-4fb6-8a25-20f9c8a5cf6c response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
22112025-01-17T08:04:06.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56504
22122025-01-17T08:04:06.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56504 req_id = 93d90092-efdc-4ed6-9fa2-ad56dbef982c response_code = 200 uri = /vpc-routes
22132025-01-17T08:04:06.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37166
22142025-01-17T08:04:06.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37166 req_id = 14a81ca6-0b59-426e-8856-4db4dda28192 response_code = 200 uri = /vpc-routes
22152025-01-17T08:04:06.772ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
22162025-01-17T08:04:06.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56504 req_id = a091f121-533f-4343-9204-01456327c7e6 response_code = 204 uri = /eip-gateways
22172025-01-17T08:04:06.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
22182025-01-17T08:04:06.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37166 req_id = fc08c552-83d3-4134-ae0a-11a910ead597 response_code = 204 uri = /eip-gateways
22192025-01-17T08:04:06.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48573
22202025-01-17T08:04:06.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48573 req_id = d206de50-4eaf-4a1e-af84-673667ee63bd response_code = 200 uri = /v2p
22212025-01-17T08:04:06.868ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49295
22222025-01-17T08:04:06.868ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22232025-01-17T08:04:06.910ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22242025-01-17T08:04:06.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103847 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49295 req_id = 347eaad8-5362-4cfb-a712-1a5eefd1cc47 response_code = 204 uri = /switch-ports
22252025-01-17T08:04:06.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64826
22262025-01-17T08:04:06.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55698
22272025-01-17T08:04:06.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34223
22282025-01-17T08:04:06.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49295 req_id = 238b888a-ee8b-4e10-896e-159953df3641 response_code = 200 uri = /network-bootstore-config
22292025-01-17T08:04:06.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34223 req_id = 44c0d36e-c29c-4561-9453-d6cf2801b8a4 response_code = 200 uri = /vpc-routes
22302025-01-17T08:04:06.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 465 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56504 req_id = 3fc219a6-88f4-4d9f-971d-137d3b15d2a8 response_code = 204 uri = /vpc-routes
22312025-01-17T08:04:06.972ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22322025-01-17T08:04:06.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 265 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55698 req_id = 608a432c-43eb-4a6f-bf2c-4177c69d8331 response_code = 200 uri = /v2p
22332025-01-17T08:04:07.019ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22342025-01-17T08:04:07.023ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
22352025-01-17T08:04:07.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 685 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34223 req_id = 3f98f575-9ff4-454b-aeef-78419a02695a response_code = 204 uri = /eip-gateways
22362025-01-17T08:04:07.027ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49171
22372025-01-17T08:04:07.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 346 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49171 req_id = a65aa0dd-ea68-4302-ae4f-4b86b89e037a response_code = 200 uri = /v2p
22382025-01-17T08:04:07.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48389
22392025-01-17T08:04:07.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37166 req_id = 6ee07fc5-25f7-49a7-8cf7-a1b46c685fc9 response_code = 204 uri = /vpc-routes
22402025-01-17T08:04:07.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109787 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64826 req_id = b91f7cad-2033-4958-9ae2-c5f4e4bcf940 response_code = 204 uri = /switch-ports
22412025-01-17T08:04:07.082ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22422025-01-17T08:04:07.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 623 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64826 req_id = 286f6b9c-baf9-4ff2-87f5-124748e783a0 response_code = 200 uri = /network-bootstore-config
22432025-01-17T08:04:07.118ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22442025-01-17T08:04:07.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 388 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34223 req_id = 8a21fc28-955d-49af-8d81-8ff97e279c62 response_code = 204 uri = /vpc-routes
22452025-01-17T08:04:07.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149659 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48389 req_id = 617d7de8-bc92-4048-92d5-2b286941e4b6 response_code = 204 uri = /switch-ports
22462025-01-17T08:04:07.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48389 req_id = 2ef8f15b-27d2-4d18-8136-ac1f57cceb39 response_code = 200 uri = /network-bootstore-config
22472025-01-17T08:04:17.683ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48644
22482025-01-17T08:04:17.683ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48644 req_id = 0209e2eb-0b78-4da3-bcfa-72b39b065a72 response_code = 200 uri = /baseboard
22492025-01-17T08:04:21.761ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9766 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 3a0fabdb-4c2f-4df7-b8ac-a2bb8515a82a response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
22502025-01-17T08:04:36.801ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58490
22512025-01-17T08:04:36.801ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58490 req_id = 64e05de5-6cd8-4db1-8154-0f2110f8df8a response_code = 200 uri = /vpc-routes
22522025-01-17T08:04:36.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52167
22532025-01-17T08:04:36.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52167 req_id = 7e968f17-b6b5-4ab7-af1e-3533be30dd33 response_code = 200 uri = /vpc-routes
22542025-01-17T08:04:36.975ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
22552025-01-17T08:04:36.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52167 req_id = 0fff0422-64e1-4da9-83a0-ec3a71d6df1e response_code = 204 uri = /eip-gateways
22562025-01-17T08:04:37.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
22572025-01-17T08:04:37.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58490 req_id = 3c8bb2b2-7bf0-45a4-92ce-38815b07b651 response_code = 204 uri = /eip-gateways
22582025-01-17T08:04:37.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58490 req_id = 638b1651-8b65-44c6-8ad4-c635366c51f6 response_code = 204 uri = /vpc-routes
22592025-01-17T08:04:37.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40436
22602025-01-17T08:04:37.067ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22612025-01-17T08:04:37.115ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22622025-01-17T08:04:37.186ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119281 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40436 req_id = 1cfd6005-a15f-4735-b888-14fde3e58aa8 response_code = 204 uri = /switch-ports
22632025-01-17T08:04:37.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51605
22642025-01-17T08:04:37.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55854
22652025-01-17T08:04:37.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40211
22662025-01-17T08:04:37.187ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44302
22672025-01-17T08:04:37.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 415 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40436 req_id = 96da458a-81ba-4828-8fdc-817fcdc64f97 response_code = 200 uri = /network-bootstore-config
22682025-01-17T08:04:37.187ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22692025-01-17T08:04:37.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 625 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52167 req_id = 614b73c8-a0a9-4cd0-8acb-efe4b862c845 response_code = 204 uri = /vpc-routes
22702025-01-17T08:04:37.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44302 req_id = cc35e697-0653-49a1-b9b5-3e392870454c response_code = 200 uri = /vpc-routes
22712025-01-17T08:04:37.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6691 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55854 req_id = 57a43a40-d137-462f-a20a-c1f78f146290 response_code = 200 uri = /v2p
22722025-01-17T08:04:37.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6679 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40211 req_id = d62d5475-4bd6-4828-a32e-2e9389736c1a response_code = 200 uri = /v2p
22732025-01-17T08:04:37.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47818
22742025-01-17T08:04:37.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47818 req_id = 2b0cc98a-f0a8-497b-98c8-a39fc30adc40 response_code = 200 uri = /v2p
22752025-01-17T08:04:37.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22762025-01-17T08:04:37.243ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
22772025-01-17T08:04:37.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 611 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44302 req_id = 6835a928-1a2d-4571-93ec-bd5343ecd2b5 response_code = 204 uri = /eip-gateways
22782025-01-17T08:04:37.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118772 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51605 req_id = 727782a2-451f-4384-9f59-751b9ab18e79 response_code = 204 uri = /switch-ports
22792025-01-17T08:04:37.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51605 req_id = 8ff4ca58-2738-4175-bdcf-3979f340d9bb response_code = 200 uri = /network-bootstore-config
22802025-01-17T08:04:37.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44302 req_id = 82d58340-8e20-4469-be47-60806c608c59 response_code = 204 uri = /vpc-routes
22812025-01-17T08:04:37.417ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42431
22822025-01-17T08:04:37.417ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22832025-01-17T08:04:37.451ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22842025-01-17T08:04:37.505ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42431 req_id = c6877938-7dcc-429e-bd3b-95de765bc3f4 response_code = 204 uri = /switch-ports
22852025-01-17T08:04:37.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42431 req_id = 544903bd-5ea3-4fe5-89e9-5db7117dc479 response_code = 200 uri = /network-bootstore-config
22862025-01-17T08:04:47.717ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47316
22872025-01-17T08:04:47.717ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:47316 req_id = 3d8e6f95-4042-4a44-80e9-e9742fc4f070 response_code = 200 uri = /baseboard
22882025-01-17T08:04:51.759ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7865 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 8c85b3e0-a786-4982-b3c1-d40068c45897 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
22892025-01-17T08:05:06.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63346
22902025-01-17T08:05:06.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63346 req_id = cc0e71de-2288-490c-987d-77d2f17648ea response_code = 200 uri = /vpc-routes
22912025-01-17T08:05:06.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63484
22922025-01-17T08:05:06.767ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63484 req_id = bbfbdc9b-5b1a-4558-8a9a-8b6d3e1a3bc2 response_code = 200 uri = /vpc-routes
22932025-01-17T08:05:06.789ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
22942025-01-17T08:05:06.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63484 req_id = ecf3e5c3-f227-4d62-9950-dbe350793a0c response_code = 204 uri = /eip-gateways
22952025-01-17T08:05:06.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63484 req_id = fd1ddec9-ace7-467c-88bc-f56825e28883 response_code = 204 uri = /vpc-routes
22962025-01-17T08:05:06.807ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
22972025-01-17T08:05:06.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63346 req_id = e3ee00d8-47de-43b9-8a79-0e3c9f254d4b response_code = 204 uri = /eip-gateways
22982025-01-17T08:05:06.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63346 req_id = 90f75882-6673-4c01-a8cb-c84eebc1d0e7 response_code = 204 uri = /vpc-routes
22992025-01-17T08:05:06.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50105
23002025-01-17T08:05:06.840ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23012025-01-17T08:05:06.880ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23022025-01-17T08:05:06.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104189 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50105 req_id = 6d572938-f1af-42ea-871b-166704507018 response_code = 204 uri = /switch-ports
23032025-01-17T08:05:06.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53631
23042025-01-17T08:05:06.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43733
23052025-01-17T08:05:06.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51943
23062025-01-17T08:05:06.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53052
23072025-01-17T08:05:06.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51943 req_id = 20c0eb5d-f06d-4c80-bc82-e8fba446f7b7 response_code = 200 uri = /vpc-routes
23082025-01-17T08:05:06.945ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23092025-01-17T08:05:06.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 270 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50105 req_id = 34acb26c-32a9-40bc-8401-09c5e8aeaf92 response_code = 200 uri = /network-bootstore-config
23102025-01-17T08:05:06.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43733 req_id = 9e91cfbb-2ab9-431d-89f8-15426759c289 response_code = 200 uri = /v2p
23112025-01-17T08:05:06.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53052 req_id = e7cac914-7288-43b5-a73b-9ef32511544e response_code = 200 uri = /v2p
23122025-01-17T08:05:06.963ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
23132025-01-17T08:05:06.963ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 548 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51943 req_id = e5c4381c-9368-4562-8f57-6cf52f4af49f response_code = 204 uri = /eip-gateways
23142025-01-17T08:05:06.983ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23152025-01-17T08:05:06.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50259
23162025-01-17T08:05:07.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50259 req_id = be5ac875-f565-4a2b-8a02-8d3a3d7cef66 response_code = 200 uri = /v2p
23172025-01-17T08:05:07.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51943 req_id = e323afe2-d41d-4dc9-bead-1bc5f2e9f128 response_code = 204 uri = /vpc-routes
23182025-01-17T08:05:07.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46518
23192025-01-17T08:05:07.046ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23202025-01-17T08:05:07.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101292 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53631 req_id = 4a7ed97e-d75a-4270-8313-8192cde7947f response_code = 204 uri = /switch-ports
23212025-01-17T08:05:07.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 624 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53631 req_id = 154832f8-04d8-4eef-8199-77746e2fe821 response_code = 200 uri = /network-bootstore-config
23222025-01-17T08:05:07.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23232025-01-17T08:05:07.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112169 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46518 req_id = 8d71ee3b-eb12-442c-a155-06cc576b3f81 response_code = 204 uri = /switch-ports
23242025-01-17T08:05:07.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46518 req_id = fb3768eb-4103-445e-948a-6ab89871f1f0 response_code = 200 uri = /network-bootstore-config
23252025-01-17T08:05:17.753ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37203
23262025-01-17T08:05:17.753ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:37203 req_id = ca1f2dd5-bce5-4fb0-b74b-54b58c8e360b response_code = 200 uri = /baseboard
23272025-01-17T08:05:21.759ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7019 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 2f7150dd-990b-469c-8d4b-02574100b9ed response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
23282025-01-17T08:05:36.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39808
23292025-01-17T08:05:36.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39808 req_id = 1714d7f5-24f1-4219-9e44-6aba80a310ab response_code = 200 uri = /vpc-routes
23302025-01-17T08:05:36.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63121
23312025-01-17T08:05:36.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63121 req_id = fc7d0089-0613-4657-bbd7-01b3afba85a3 response_code = 200 uri = /vpc-routes
23322025-01-17T08:05:36.912ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
23332025-01-17T08:05:36.912ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63121 req_id = 27b4d898-d27d-4405-b3c7-e87f5e3cde97 response_code = 204 uri = /eip-gateways
23342025-01-17T08:05:36.931ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63121 req_id = b3e2d496-32d1-4256-b39a-01161cd2c177 response_code = 204 uri = /vpc-routes
23352025-01-17T08:05:36.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
23362025-01-17T08:05:36.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39808 req_id = 9d0ad72d-6c00-4b6f-824a-6a0f2cafb8f7 response_code = 204 uri = /eip-gateways
23372025-01-17T08:05:36.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39808 req_id = 8ba25dd3-34a7-40aa-8518-9cf82dbb083c response_code = 204 uri = /vpc-routes
23382025-01-17T08:05:37.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41742
23392025-01-17T08:05:37.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41742 req_id = c6977e45-ec36-4775-8fc3-4937d4280dc5 response_code = 200 uri = /vpc-routes
23402025-01-17T08:05:37.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62420
23412025-01-17T08:05:37.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62420 req_id = f07df5c2-6fb1-4a62-840c-d2a06619dcd4 response_code = 200 uri = /v2p
23422025-01-17T08:05:37.141ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
23432025-01-17T08:05:37.141ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41742 req_id = d4a74637-e3a6-4607-b6b5-b08a46cef996 response_code = 204 uri = /eip-gateways
23442025-01-17T08:05:37.146ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57291
23452025-01-17T08:05:37.146ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23462025-01-17T08:05:37.190ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23472025-01-17T08:05:37.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112886 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57291 req_id = c672149c-7f8c-4bd1-b8e3-143e0a9319b7 response_code = 204 uri = /switch-ports
23482025-01-17T08:05:37.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46867
23492025-01-17T08:05:37.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43278
23502025-01-17T08:05:37.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43974
23512025-01-17T08:05:37.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33785
23522025-01-17T08:05:37.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44052
23532025-01-17T08:05:37.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 356 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57291 req_id = 8b4dd756-bc82-41c2-9967-ff1a7631685b response_code = 200 uri = /network-bootstore-config
23542025-01-17T08:05:37.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 335 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46867 req_id = 3074f4fd-8f33-4c03-b48b-090f1203d962 response_code = 200 uri = /v2p
23552025-01-17T08:05:37.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43278 req_id = a078c98e-8307-474d-b4d7-144d7cc4ee10 response_code = 200 uri = /v2p
23562025-01-17T08:05:37.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 658 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41742 req_id = f2880d9f-7e93-4e8b-9806-8d273df5bfc0 response_code = 204 uri = /vpc-routes
23572025-01-17T08:05:37.260ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23582025-01-17T08:05:37.266ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23592025-01-17T08:05:37.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23602025-01-17T08:05:37.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23612025-01-17T08:05:37.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23622025-01-17T08:05:37.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23632025-01-17T08:05:37.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23642025-01-17T08:05:37.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23652025-01-17T08:05:37.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 11823 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43974 req_id = 993a6211-ddcc-488b-810a-3be0f36babfe response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23662025-01-17T08:05:37.304ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23672025-01-17T08:05:37.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62956
23682025-01-17T08:05:37.353ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23692025-01-17T08:05:37.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23702025-01-17T08:05:37.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23712025-01-17T08:05:37.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23722025-01-17T08:05:37.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23732025-01-17T08:05:37.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23742025-01-17T08:05:37.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23752025-01-17T08:05:37.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 435 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62956 req_id = f3891241-c95d-4558-be1f-f43b3d83cd58 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23762025-01-17T08:05:37.365ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23772025-01-17T08:05:37.365ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105815 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33785 req_id = cbd0d163-fe0d-4d51-96cd-c74fb9cf0f3c response_code = 204 uri = /switch-ports
23782025-01-17T08:05:37.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33785 req_id = 198e5b4a-b7bc-48e5-b968-f5a1ff9bd143 response_code = 200 uri = /network-bootstore-config
23792025-01-17T08:05:37.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63195
23802025-01-17T08:05:37.402ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23812025-01-17T08:05:37.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23822025-01-17T08:05:37.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23832025-01-17T08:05:37.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23842025-01-17T08:05:37.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23852025-01-17T08:05:37.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23862025-01-17T08:05:37.402ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23872025-01-17T08:05:37.402ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 453 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63195 req_id = bb13c50d-5875-4ead-a047-be93081a08b1 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23882025-01-17T08:05:37.403ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23892025-01-17T08:05:37.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 199164 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44052 req_id = b1f2559c-d2a6-43cf-88a7-08c8f62a32d9 response_code = 204 uri = /switch-ports
23902025-01-17T08:05:37.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44052 req_id = 6d33857b-7544-48da-a76b-da21d5ee5fb3 response_code = 200 uri = /network-bootstore-config
23912025-01-17T08:05:47.788ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55829
23922025-01-17T08:05:47.788ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55829 req_id = 62acd90d-2848-4b7d-89b1-e7e5e1ed1534 response_code = 200 uri = /baseboard
23932025-01-17T08:05:51.761ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7743 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 906f2814-7371-4767-8d9f-20b8bc501c7b response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
23942025-01-17T08:06:06.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62589
23952025-01-17T08:06:06.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62589 req_id = 8ff50645-c634-4df7-baf3-e245e27be987 response_code = 200 uri = /vpc-routes
23962025-01-17T08:06:06.711ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52105
23972025-01-17T08:06:06.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52105 req_id = 6c059fd7-b2c7-4ee8-b861-da900761ce85 response_code = 200 uri = /vpc-routes
23982025-01-17T08:06:06.735ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
23992025-01-17T08:06:06.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62589 req_id = c0141fb0-c0bd-49f6-8348-c84c4cc806f1 response_code = 204 uri = /eip-gateways
24002025-01-17T08:06:06.748ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62589 req_id = ef95abdd-1bc8-4013-9653-0de696e99983 response_code = 204 uri = /vpc-routes
24012025-01-17T08:06:06.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
24022025-01-17T08:06:06.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52105 req_id = 14a2d553-e1c9-468e-abd8-1df50fd61f64 response_code = 204 uri = /eip-gateways
24032025-01-17T08:06:06.807ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52105 req_id = f71ec673-e710-4007-b691-71a9c2e0be7b response_code = 204 uri = /vpc-routes
24042025-01-17T08:06:06.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33640
24052025-01-17T08:06:06.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33640 req_id = 64918071-cbbe-43dd-b2a5-2e538b1fd5bd response_code = 200 uri = /v2p
24062025-01-17T08:06:06.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49922
24072025-01-17T08:06:06.837ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24082025-01-17T08:06:06.881ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24092025-01-17T08:06:06.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103692 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49922 req_id = 0f5a28b5-bc10-482d-a35c-486d3c5b0876 response_code = 204 uri = /switch-ports
24102025-01-17T08:06:06.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55742
24112025-01-17T08:06:06.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58382
24122025-01-17T08:06:06.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49922 req_id = 99351161-7fd3-453f-9c9a-5f389a62fafb response_code = 200 uri = /network-bootstore-config
24132025-01-17T08:06:06.942ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24142025-01-17T08:06:06.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58382 req_id = fc80dde8-ec9e-4dbd-89d5-102e5362cae6 response_code = 200 uri = /v2p
24152025-01-17T08:06:06.956ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48722
24162025-01-17T08:06:06.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48722 req_id = 88f53da9-2bfe-4dbd-801a-b680167ba562 response_code = 200 uri = /vpc-routes
24172025-01-17T08:06:06.981ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24182025-01-17T08:06:06.998ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
24192025-01-17T08:06:06.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48722 req_id = 3bbd1832-c3a0-4789-aff4-967b24cd6f13 response_code = 204 uri = /eip-gateways
24202025-01-17T08:06:07.007ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61328
24212025-01-17T08:06:07.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61328 req_id = 8668570c-b25f-412f-a927-27b41a6a9d4e response_code = 200 uri = /v2p
24222025-01-17T08:06:07.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48722 req_id = 60c26695-d68a-45d0-a935-930cfa13e80a response_code = 204 uri = /vpc-routes
24232025-01-17T08:06:07.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55742 req_id = 696b084f-c278-4ff4-8883-0ab0cebd8279 response_code = 204 uri = /switch-ports
24242025-01-17T08:06:07.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55742 req_id = 1451f3a6-8a65-42bb-833a-8929d2992be8 response_code = 200 uri = /network-bootstore-config
24252025-01-17T08:06:07.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47283
24262025-01-17T08:06:07.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24272025-01-17T08:06:07.090ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24282025-01-17T08:06:07.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91911 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47283 req_id = 2c884090-f699-4d07-8df9-9b68e036f2c3 response_code = 204 uri = /switch-ports
24292025-01-17T08:06:07.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47283 req_id = faceb9e4-4d8a-4d33-8b50-b85c4a316339 response_code = 200 uri = /network-bootstore-config
24302025-01-17T08:06:17.821ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60176
24312025-01-17T08:06:17.821ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60176 req_id = 03009a57-1127-4d08-9e86-d741060bfd79 response_code = 200 uri = /baseboard
24322025-01-17T08:06:21.761ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7821 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 9a236706-df83-43b3-9080-d769cc22310a response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
24332025-01-17T08:06:36.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56874
24342025-01-17T08:06:36.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56874 req_id = 973d1192-5199-4cd3-906f-a831d0fcc48c response_code = 200 uri = /vpc-routes
24352025-01-17T08:06:36.871ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52001
24362025-01-17T08:06:36.871ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52001 req_id = 5a5dbe29-513d-4070-a394-f1299a27b012 response_code = 200 uri = /vpc-routes
24372025-01-17T08:06:36.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46165
24382025-01-17T08:06:36.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46165 req_id = 54ecb048-fc8e-40ba-a482-0097819c7c0e response_code = 200 uri = /v2p
24392025-01-17T08:06:36.923ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
24402025-01-17T08:06:36.923ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56874 req_id = 503efc27-cdf7-4e92-bbe0-03905486211e response_code = 204 uri = /eip-gateways
24412025-01-17T08:06:36.933ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
24422025-01-17T08:06:36.933ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52001 req_id = ed32acf4-5396-4966-84ed-469eb5db8b94 response_code = 204 uri = /eip-gateways
24432025-01-17T08:06:36.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56874 req_id = a5c8a605-ab59-4981-bf02-5864ad996e21 response_code = 204 uri = /vpc-routes
24442025-01-17T08:06:36.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36792
24452025-01-17T08:06:36.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36792 req_id = 0c3633e4-fe65-4f48-a00e-00a54de26573 response_code = 200 uri = /vpc-routes
24462025-01-17T08:06:36.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52001 req_id = 158ceb15-7d6a-497c-8e4d-c2e2f6ea8f78 response_code = 204 uri = /vpc-routes
24472025-01-17T08:06:37.025ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
24482025-01-17T08:06:37.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36792 req_id = 7cd15091-3d80-4915-8d74-98804fa3649a response_code = 204 uri = /eip-gateways
24492025-01-17T08:06:37.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36792 req_id = cf44fdf4-5bbb-4074-8265-d198fc0ab61b response_code = 204 uri = /vpc-routes
24502025-01-17T08:06:37.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60288
24512025-01-17T08:06:37.081ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24522025-01-17T08:06:37.121ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24532025-01-17T08:06:37.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99762 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:60288 req_id = c58cfc41-c4aa-4205-83a7-d503ecf4d6d9 response_code = 204 uri = /switch-ports
24542025-01-17T08:06:37.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64248
24552025-01-17T08:06:37.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64082
24562025-01-17T08:06:37.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60288 req_id = c8baf244-eb3b-4de9-9fe8-9b066d48bd5f response_code = 200 uri = /network-bootstore-config
24572025-01-17T08:06:37.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24582025-01-17T08:06:37.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3441 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64248 req_id = 2b996b43-863c-4ddb-ad1a-d0d5d526a538 response_code = 200 uri = /v2p
24592025-01-17T08:06:37.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57284
24602025-01-17T08:06:37.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57284 req_id = 9d099921-8b9c-48d6-91a1-ba0a892ad751 response_code = 200 uri = /v2p
24612025-01-17T08:06:37.215ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24622025-01-17T08:06:37.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64082 req_id = 0d5ba9ba-d48d-4b6b-a26e-7133258cb120 response_code = 204 uri = /switch-ports
24632025-01-17T08:06:37.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64082 req_id = 1e3dc971-750e-4578-ab0a-967358acf70e response_code = 200 uri = /network-bootstore-config
24642025-01-17T08:06:37.279ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53554
24652025-01-17T08:06:37.279ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24662025-01-17T08:06:37.314ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24672025-01-17T08:06:37.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90964 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53554 req_id = 336751c0-bbfc-4a73-a3cd-587e10184600 response_code = 204 uri = /switch-ports
24682025-01-17T08:06:37.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53554 req_id = 4c8aaf01-5bd9-4e22-ab52-f905552640ac response_code = 200 uri = /network-bootstore-config
24692025-01-17T08:06:47.859ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40147
24702025-01-17T08:06:47.859ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40147 req_id = ff51b348-476c-4098-bd35-6e098e0c38c7 response_code = 200 uri = /baseboard
24712025-01-17T08:06:51.760ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7006 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 92f942d0-8578-446a-8bca-ab1b35dcef9f response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
24722025-01-17T08:07:06.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47964
24732025-01-17T08:07:06.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47964 req_id = ab728539-46c1-4abd-a9d5-6d6c632368b7 response_code = 200 uri = /vpc-routes
24742025-01-17T08:07:06.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
24752025-01-17T08:07:06.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47964 req_id = 2f40ee80-9b80-4501-9618-d943c6be463e response_code = 204 uri = /eip-gateways
24762025-01-17T08:07:06.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47964 req_id = 758b1c32-cd2e-46cf-b8fe-c459746a1d5f response_code = 204 uri = /vpc-routes
24772025-01-17T08:07:06.816ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57875
24782025-01-17T08:07:06.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57875 req_id = 2b8c9577-cc15-4dab-abc8-a3137ad67924 response_code = 200 uri = /v2p
24792025-01-17T08:07:06.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64181
24802025-01-17T08:07:06.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64181 req_id = 41e9e8d1-384f-4c06-8551-785e74416026 response_code = 200 uri = /vpc-routes
24812025-01-17T08:07:06.838ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
24822025-01-17T08:07:06.838ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64181 req_id = 294c008d-c9bd-4396-b937-ec757018acff response_code = 204 uri = /eip-gateways
24832025-01-17T08:07:06.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40734
24842025-01-17T08:07:06.838ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24852025-01-17T08:07:06.883ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24862025-01-17T08:07:06.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109459 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40734 req_id = 4f4a640a-5375-4c85-99f1-ec9a4d613097 response_code = 204 uri = /switch-ports
24872025-01-17T08:07:06.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60331
24882025-01-17T08:07:06.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61966
24892025-01-17T08:07:06.948ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57055
24902025-01-17T08:07:06.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64181 req_id = f9ba8993-fbd5-45f5-998a-f9a0df942027 response_code = 204 uri = /vpc-routes
24912025-01-17T08:07:06.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40734 req_id = b3fe7713-ec13-4044-b9a2-24d98ff4cc53 response_code = 200 uri = /network-bootstore-config
24922025-01-17T08:07:06.948ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24932025-01-17T08:07:06.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61966 req_id = 150f90d9-d806-4c88-89ba-5e3a8579e754 response_code = 200 uri = /vpc-routes
24942025-01-17T08:07:06.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 570 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60331 req_id = d952c59d-370c-4d53-bef7-ea2d69f9805a response_code = 200 uri = /v2p
24952025-01-17T08:07:06.988ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24962025-01-17T08:07:06.994ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
24972025-01-17T08:07:06.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61966 req_id = b36f2016-77d1-46eb-9c33-f7e767b6056f response_code = 204 uri = /eip-gateways
24982025-01-17T08:07:07.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41011
24992025-01-17T08:07:07.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41011 req_id = 6d8ab1a9-4549-43fd-8ec4-f4cdf007e528 response_code = 200 uri = /v2p
25002025-01-17T08:07:07.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61966 req_id = 65801886-082c-4a6c-9d21-cbb639326a34 response_code = 204 uri = /vpc-routes
25012025-01-17T08:07:07.023ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40200
25022025-01-17T08:07:07.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95058 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57055 req_id = da1c2e4e-2c2a-4f6c-a120-c7d9c76f4538 response_code = 204 uri = /switch-ports
25032025-01-17T08:07:07.043ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25042025-01-17T08:07:07.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 705 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57055 req_id = ee9411f1-abdb-4f36-afae-dc16eceb5c38 response_code = 200 uri = /network-bootstore-config
25052025-01-17T08:07:07.080ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25062025-01-17T08:07:07.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115967 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40200 req_id = 044ad3b5-10c6-491e-bb89-33748f867a32 response_code = 204 uri = /switch-ports
25072025-01-17T08:07:07.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40200 req_id = 38cc5afd-387c-4bef-bafb-3d1f3a4775ba response_code = 200 uri = /network-bootstore-config
25082025-01-17T08:07:17.894ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36674
25092025-01-17T08:07:17.894ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36674 req_id = 243c1fe5-a15d-41a0-a28d-7166c6754028 response_code = 200 uri = /baseboard
25102025-01-17T08:07:21.761ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7064 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 1914359b-efbc-450d-b1a0-38dad805e023 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
25112025-01-17T08:07:36.717ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52776
25122025-01-17T08:07:36.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52776 req_id = 9a99603f-c1ed-4214-aa22-f1625151268e response_code = 200 uri = /vpc-routes
25132025-01-17T08:07:36.814ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
25142025-01-17T08:07:36.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52776 req_id = 45cfb577-1428-42ba-b573-609770e5f594 response_code = 204 uri = /eip-gateways
25152025-01-17T08:07:36.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52776 req_id = 7c82cd8c-32e8-419e-945a-5efa3bce43f5 response_code = 204 uri = /vpc-routes
25162025-01-17T08:07:36.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34940
25172025-01-17T08:07:36.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34940 req_id = 81b362c3-f00a-4809-95b8-57bdc205b5b9 response_code = 200 uri = /vpc-routes
25182025-01-17T08:07:37.001ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
25192025-01-17T08:07:37.001ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34940 req_id = dbe8809a-f46d-4185-8d2e-669bdfb66a3c response_code = 204 uri = /eip-gateways
25202025-01-17T08:07:37.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35115
25212025-01-17T08:07:37.041ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35115 req_id = 94b0d9af-6fcc-4025-b0c8-f240fa162a74 response_code = 200 uri = /v2p
25222025-01-17T08:07:37.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34940 req_id = 7d878522-8e63-4038-8a8f-738ad2c2076e response_code = 204 uri = /vpc-routes
25232025-01-17T08:07:37.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61729
25242025-01-17T08:07:37.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61729 req_id = 2f86f4a6-270a-412c-8a82-4ed6874b5c0b response_code = 200 uri = /v2p
25252025-01-17T08:07:37.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54733
25262025-01-17T08:07:37.070ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25272025-01-17T08:07:37.124ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25282025-01-17T08:07:37.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54733 req_id = 4ee145fa-62f8-4cdf-ba5a-6474bbe06f29 response_code = 204 uri = /switch-ports
25292025-01-17T08:07:37.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54882
25302025-01-17T08:07:37.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64955
25312025-01-17T08:07:37.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54882 req_id = 8cffab93-8e1f-40bc-902e-be84573fd0e7 response_code = 200 uri = /vpc-routes
25322025-01-17T08:07:37.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54733 req_id = 6c3bbb86-1e29-48d4-bfd4-4f0bba547cf0 response_code = 200 uri = /network-bootstore-config
25332025-01-17T08:07:37.206ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25342025-01-17T08:07:37.246ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25352025-01-17T08:07:37.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48805
25362025-01-17T08:07:37.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48805 req_id = 5b408e3a-c2e7-4bae-85a4-6c51bbd33e18 response_code = 200 uri = /v2p
25372025-01-17T08:07:37.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97732 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64955 req_id = 2db86cac-eb30-46f2-995d-c666bf686aea response_code = 204 uri = /switch-ports
25382025-01-17T08:07:37.304ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
25392025-01-17T08:07:37.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54882 req_id = 62b8440a-66ae-4177-b58a-4fe4e8b5dc0e response_code = 204 uri = /eip-gateways
25402025-01-17T08:07:37.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64955 req_id = 1e07d477-23c4-43ec-9a42-f20a0e153ca5 response_code = 200 uri = /network-bootstore-config
25412025-01-17T08:07:37.311ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45096
25422025-01-17T08:07:37.311ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25432025-01-17T08:07:37.348ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25442025-01-17T08:07:37.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93744 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45096 req_id = d6a66956-fd8f-4f9e-9a58-8825e09abdb5 response_code = 204 uri = /switch-ports
25452025-01-17T08:07:37.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45096 req_id = 5fca893c-cf2d-4852-aeaf-d45a4eb9a944 response_code = 200 uri = /network-bootstore-config
25462025-01-17T08:07:37.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 456 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54882 req_id = ce8b2dcc-cbfc-481b-aefa-e8ba89fcb2d1 response_code = 204 uri = /vpc-routes
25472025-01-17T08:07:47.929ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48958
25482025-01-17T08:07:47.929ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48958 req_id = b0a423a6-5386-4349-bfc3-4c768aaa885e response_code = 200 uri = /baseboard
25492025-01-17T08:07:51.762ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7816 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 7e1865a3-f3e4-4a72-9378-76ca18ed943e response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
25502025-01-17T08:08:06.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36547
25512025-01-17T08:08:06.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36547 req_id = 1e66c23d-2824-4304-b6ac-4dce064768c4 response_code = 200 uri = /vpc-routes
25522025-01-17T08:08:06.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54722
25532025-01-17T08:08:06.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54722 req_id = efcec7c0-8486-41b4-92bf-4fbf0b8f7c2f response_code = 200 uri = /v2p
25542025-01-17T08:08:06.785ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
25552025-01-17T08:08:06.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36547 req_id = f3b2a3ce-8857-4e7f-ae3c-2962bfd37e0a response_code = 204 uri = /eip-gateways
25562025-01-17T08:08:06.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54978
25572025-01-17T08:08:06.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54978 req_id = fcf3ef0a-459b-4e68-bb25-eb90f0f9e1c4 response_code = 200 uri = /vpc-routes
25582025-01-17T08:08:06.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36547 req_id = da8c16fd-974f-4a69-bffa-a4c1bf7a3ee6 response_code = 204 uri = /vpc-routes
25592025-01-17T08:08:06.837ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
25602025-01-17T08:08:06.837ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54978 req_id = 2bae9984-f3e7-49f8-98fa-2780027a8d09 response_code = 204 uri = /eip-gateways
25612025-01-17T08:08:06.850ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54978 req_id = dd9e7e8a-c059-4085-bda9-c43ca3d53b3e response_code = 204 uri = /vpc-routes
25622025-01-17T08:08:06.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55852
25632025-01-17T08:08:06.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55852 req_id = 64a52b3d-c443-4d15-90f0-60205e7cd755 response_code = 200 uri = /v2p
25642025-01-17T08:08:06.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41959
25652025-01-17T08:08:06.886ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25662025-01-17T08:08:06.924ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25672025-01-17T08:08:06.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94555 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41959 req_id = 0ed895ba-c356-4b7b-8456-d36491f18c6f response_code = 204 uri = /switch-ports
25682025-01-17T08:08:06.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42584
25692025-01-17T08:08:06.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33609
25702025-01-17T08:08:06.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41959 req_id = 2694b045-6f6f-43f0-b1a0-0ac007fdbdcd response_code = 200 uri = /network-bootstore-config
25712025-01-17T08:08:06.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33609 req_id = 1b96da45-ed2f-41fa-859f-9b53b1596c65 response_code = 200 uri = /vpc-routes
25722025-01-17T08:08:06.981ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25732025-01-17T08:08:07.002ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
25742025-01-17T08:08:07.002ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33609 req_id = d83e693c-d032-47f0-adec-c0d57f1e7c08 response_code = 204 uri = /eip-gateways
25752025-01-17T08:08:07.023ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25762025-01-17T08:08:07.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34758
25772025-01-17T08:08:07.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34758 req_id = 806bf8ba-7d9f-481a-9b1a-f30cf27e25ba response_code = 200 uri = /v2p
25782025-01-17T08:08:07.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33609 req_id = c353c795-7bb5-400d-a6f0-3dbcdaac6182 response_code = 204 uri = /vpc-routes
25792025-01-17T08:08:07.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42584 req_id = f731f6bf-622e-497b-b5a1-2f7bbfa223d2 response_code = 204 uri = /switch-ports
25802025-01-17T08:08:07.079ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42584 req_id = 8e93a794-f177-45ce-9715-45441ec7bad4 response_code = 200 uri = /network-bootstore-config
25812025-01-17T08:08:07.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48503
25822025-01-17T08:08:07.091ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25832025-01-17T08:08:07.125ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25842025-01-17T08:08:07.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90988 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48503 req_id = 83a5b3a6-5244-439a-9732-11c9537e0356 response_code = 204 uri = /switch-ports
25852025-01-17T08:08:07.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48503 req_id = eb988526-2e7c-4acc-9163-b0dded985786 response_code = 200 uri = /network-bootstore-config
25862025-01-17T08:08:17.963ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36282
25872025-01-17T08:08:17.963ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:36282 req_id = f533894b-d4e5-4960-973f-83747b290651 response_code = 200 uri = /baseboard
25882025-01-17T08:08:21.762ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7344 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 0866e7ae-012b-4cf6-9cf9-0723b81c9a3c response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
25892025-01-17T08:08:26.869ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
25902025-01-17T08:08:26.870ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25912025-01-17T08:08:26.901ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2026, tv_nsec: 27171372 } time_to_next_cleanup = 599.99999971s
25922025-01-17T08:08:36.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50710
25932025-01-17T08:08:36.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50710 req_id = 8b3469a7-412a-4927-8eef-fc8a75bae5cb response_code = 200 uri = /vpc-routes
25942025-01-17T08:08:36.902ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44700
25952025-01-17T08:08:36.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44700 req_id = dd42382a-100b-410d-b1b1-ccb8ecccddc8 response_code = 200 uri = /vpc-routes
25962025-01-17T08:08:36.920ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
25972025-01-17T08:08:36.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44700 req_id = a578a998-0d59-4e53-b0c2-4b35741f3a6e response_code = 204 uri = /eip-gateways
25982025-01-17T08:08:36.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44700 req_id = fd507bc1-04cb-4e37-8c62-88db2a067f08 response_code = 204 uri = /vpc-routes
25992025-01-17T08:08:36.945ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
26002025-01-17T08:08:36.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50710 req_id = 1f3e253a-964e-42f5-beb0-b83b5fb3a4b8 response_code = 204 uri = /eip-gateways
26012025-01-17T08:08:36.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50710 req_id = 27e765fa-fe63-4515-a806-c92224b80447 response_code = 204 uri = /vpc-routes
26022025-01-17T08:08:36.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45586
26032025-01-17T08:08:36.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45586 req_id = 9e3e3995-672c-413c-8210-73aea333c115 response_code = 200 uri = /v2p
26042025-01-17T08:08:37.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47076
26052025-01-17T08:08:37.012ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47076 req_id = fc467efd-2a07-4514-927d-b788747731a6 response_code = 200 uri = /v2p
26062025-01-17T08:08:37.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53463
26072025-01-17T08:08:37.054ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26082025-01-17T08:08:37.105ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26092025-01-17T08:08:37.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142227 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53463 req_id = 349a2c3e-07f0-4c0d-b276-2c0fda44f1d5 response_code = 204 uri = /switch-ports
26102025-01-17T08:08:37.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35331
26112025-01-17T08:08:37.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64366
26122025-01-17T08:08:37.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64366 req_id = a6d8aeb6-0fe8-45f1-b5d7-e64500c9d7dd response_code = 200 uri = /vpc-routes
26132025-01-17T08:08:37.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53463 req_id = 8e737b40-c25a-4d52-8bf4-7388002b47e1 response_code = 200 uri = /network-bootstore-config
26142025-01-17T08:08:37.196ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26152025-01-17T08:08:37.243ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26162025-01-17T08:08:37.247ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
26172025-01-17T08:08:37.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 626 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64366 req_id = f580923d-2b91-48be-8d7e-b36712eb62b5 response_code = 204 uri = /eip-gateways
26182025-01-17T08:08:37.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 516 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64366 req_id = 7d9c650e-100a-43be-b304-8978a858a960 response_code = 204 uri = /vpc-routes
26192025-01-17T08:08:37.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117430 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35331 req_id = 04c6479a-e713-41f5-821d-e3fbaa4ff205 response_code = 204 uri = /switch-ports
26202025-01-17T08:08:37.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35331 req_id = 64716837-456b-4a96-bcd8-f64ba66dfcb9 response_code = 200 uri = /network-bootstore-config
26212025-01-17T08:08:37.316ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64458
26222025-01-17T08:08:37.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64458 req_id = 74684372-d92d-4620-a693-4410dc97dcc1 response_code = 200 uri = /v2p
26232025-01-17T08:08:37.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63407
26242025-01-17T08:08:37.342ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26252025-01-17T08:08:37.381ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26262025-01-17T08:08:37.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98665 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63407 req_id = 80130625-7ef0-468d-a1a5-d59fd37eb5eb response_code = 204 uri = /switch-ports
26272025-01-17T08:08:37.445ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63407 req_id = 0e2a4c11-57fe-4cf6-a9cb-47e3b35591fe response_code = 200 uri = /network-bootstore-config
26282025-01-17T08:08:41.593ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
26292025-01-17T08:08:47.997ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55445
26302025-01-17T08:08:47.997ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:55445 req_id = d89fbf0f-36eb-4dbc-9227-a58b1c041b35 response_code = 200 uri = /baseboard
26312025-01-17T08:08:51.762ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7236 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 09024c86-6b83-4e68-8841-1f56dfa13e46 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
26322025-01-17T08:09:06.703ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59819
26332025-01-17T08:09:06.703ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59819 req_id = caf85939-9b6d-4f5e-af22-6c1aaf452317 response_code = 200 uri = /vpc-routes
26342025-01-17T08:09:06.718ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
26352025-01-17T08:09:06.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59819 req_id = fc3374f6-d7b2-49f2-b6e0-02499ae29c83 response_code = 204 uri = /eip-gateways
26362025-01-17T08:09:06.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52607
26372025-01-17T08:09:06.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52607 req_id = 5e5fa8cf-5417-4d9c-b7dc-efe59f4387e2 response_code = 200 uri = /vpc-routes
26382025-01-17T08:09:06.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 206 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59819 req_id = e529c014-5711-4d85-b4a5-4647768ec170 response_code = 204 uri = /vpc-routes
26392025-01-17T08:09:06.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64989
26402025-01-17T08:09:06.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64989 req_id = 8d1c8134-3421-46a1-8bd1-6347deb20455 response_code = 200 uri = /v2p
26412025-01-17T08:09:06.784ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
26422025-01-17T08:09:06.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52607 req_id = 3269de2d-8c87-46d6-9999-f121e8dbc15e response_code = 204 uri = /eip-gateways
26432025-01-17T08:09:06.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52607 req_id = 6c6323cb-6f33-4cf3-976b-3cfb2d852008 response_code = 204 uri = /vpc-routes
26442025-01-17T08:09:06.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62557
26452025-01-17T08:09:06.822ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26462025-01-17T08:09:06.870ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26472025-01-17T08:09:06.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62557 req_id = c23751f5-e399-458b-ab9b-f7e8d817718f response_code = 204 uri = /switch-ports
26482025-01-17T08:09:06.935ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45620
26492025-01-17T08:09:06.935ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62557 req_id = 62bdd5e8-8f75-41e0-a491-6685a2736a06 response_code = 200 uri = /network-bootstore-config
26502025-01-17T08:09:06.935ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26512025-01-17T08:09:06.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60778
26522025-01-17T08:09:06.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60778 req_id = a1edab92-cb62-48c8-897b-b71895a561c3 response_code = 200 uri = /v2p
26532025-01-17T08:09:06.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56588
26542025-01-17T08:09:06.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56588 req_id = 4f09ce9c-6675-438f-86fa-86f5282eb9b3 response_code = 200 uri = /vpc-routes
26552025-01-17T08:09:06.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26562025-01-17T08:09:07.010ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
26572025-01-17T08:09:07.010ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56588 req_id = dca29b12-2a8d-47f7-9387-1e8a40081b5b response_code = 204 uri = /eip-gateways
26582025-01-17T08:09:07.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 927 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56588 req_id = 943dd176-cecf-43d4-8ebf-0b87106a4065 response_code = 204 uri = /vpc-routes
26592025-01-17T08:09:07.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44524
26602025-01-17T08:09:07.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44524 req_id = ee7e9a45-52ba-4b38-a5b6-402ea9e3743b response_code = 200 uri = /v2p
26612025-01-17T08:09:07.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99358 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45620 req_id = 8f433f48-7c3f-4003-b987-844c87004492 response_code = 204 uri = /switch-ports
26622025-01-17T08:09:07.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45620 req_id = 764d01ff-fed2-4075-9082-83b33f6af5f5 response_code = 200 uri = /network-bootstore-config
26632025-01-17T08:09:07.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61032
26642025-01-17T08:09:07.038ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26652025-01-17T08:09:07.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26662025-01-17T08:09:07.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94678 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61032 req_id = 4b31abb3-06b9-4e88-b01d-0d26c986c42c response_code = 204 uri = /switch-ports
26672025-01-17T08:09:07.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61032 req_id = e23d134f-d5d6-410b-81a4-cc01bf8340ed response_code = 200 uri = /network-bootstore-config
26682025-01-17T08:09:18.030ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38882
26692025-01-17T08:09:18.030ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38882 req_id = 8af6c78b-0eec-48c5-9292-8942c4f5b8fe response_code = 200 uri = /baseboard
26702025-01-17T08:09:21.767ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 11211 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = e674539a-c256-43f3-8986-380c2ab49c59 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
26712025-01-17T08:09:36.865ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60373
26722025-01-17T08:09:36.865ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60373 req_id = ab53483c-6cd4-458c-8242-23e53a262238 response_code = 200 uri = /vpc-routes
26732025-01-17T08:09:36.915ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36455
26742025-01-17T08:09:36.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36455 req_id = 1c5b753a-f9b9-49c2-b524-f242130e13fb response_code = 200 uri = /v2p
26752025-01-17T08:09:36.916ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
26762025-01-17T08:09:36.916ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60373 req_id = 8b532370-3eed-4f89-80cf-193ac103b6ce response_code = 204 uri = /eip-gateways
26772025-01-17T08:09:36.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54237
26782025-01-17T08:09:36.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54237 req_id = 0817bc1c-ae32-410f-a375-de1de8da437d response_code = 200 uri = /vpc-routes
26792025-01-17T08:09:36.939ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
26802025-01-17T08:09:36.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54237 req_id = 5e069f29-8d41-4823-9f91-4a17f84bf599 response_code = 204 uri = /eip-gateways
26812025-01-17T08:09:36.949ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54237 req_id = f7156959-d68b-4c3e-9e7c-1a56e0d70de4 response_code = 204 uri = /vpc-routes
26822025-01-17T08:09:36.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38706
26832025-01-17T08:09:36.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38706 req_id = e30e3e13-a0b3-4300-bdd6-c6cc97167417 response_code = 200 uri = /v2p
26842025-01-17T08:09:36.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60373 req_id = df93eaf8-7137-439e-b71a-fd0887256c21 response_code = 204 uri = /vpc-routes
26852025-01-17T08:09:37.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47081
26862025-01-17T08:09:37.110ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47081 req_id = 1de83d4a-a1f0-49ea-ab69-d669bb912054 response_code = 200 uri = /vpc-routes
26872025-01-17T08:09:37.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54625
26882025-01-17T08:09:37.122ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26892025-01-17T08:09:37.163ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26902025-01-17T08:09:37.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90000 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54625 req_id = 74f41947-afef-469b-9f32-1722ef18fc32 response_code = 204 uri = /switch-ports
26912025-01-17T08:09:37.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47808
26922025-01-17T08:09:37.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57403
26932025-01-17T08:09:37.213ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
26942025-01-17T08:09:37.213ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26952025-01-17T08:09:37.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47081 req_id = 4fd42458-b1f4-4a66-8128-34ec77c67158 response_code = 204 uri = /eip-gateways
26962025-01-17T08:09:37.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3371 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57403 req_id = 22a97e2d-6f67-4ca1-8e3d-9034d4a4495c response_code = 200 uri = /v2p
26972025-01-17T08:09:37.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3597 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54625 req_id = aa6693cb-b36f-495f-b0c3-417464071aa7 response_code = 200 uri = /network-bootstore-config
26982025-01-17T08:09:37.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47081 req_id = 1768af1a-dfa3-4854-871f-216bc41199b4 response_code = 204 uri = /vpc-routes
26992025-01-17T08:09:37.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27002025-01-17T08:09:37.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59216
27012025-01-17T08:09:37.299ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27022025-01-17T08:09:37.299ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86213 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47808 req_id = fd9177a1-b9e3-4e71-bcd0-2f13c8bd2fc2 response_code = 204 uri = /switch-ports
27032025-01-17T08:09:37.302ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 534 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47808 req_id = d291280d-9310-4afb-91ac-402618344385 response_code = 200 uri = /network-bootstore-config
27042025-01-17T08:09:37.333ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27052025-01-17T08:09:37.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99235 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59216 req_id = 07b4a731-5e71-42d6-8aaf-ea8c8b8843a6 response_code = 204 uri = /switch-ports
27062025-01-17T08:09:37.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59216 req_id = cf7aa34e-22e3-4b2d-a09a-2668652a7413 response_code = 200 uri = /network-bootstore-config
27072025-01-17T08:09:48.063ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61349
27082025-01-17T08:09:48.063ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:61349 req_id = e93bf876-f9e5-411f-bbeb-cadf871ff4c0 response_code = 200 uri = /baseboard
27092025-01-17T08:09:51.762ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6907 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = bb5be032-eecb-44b7-9c7f-51998425fa86 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
27102025-01-17T08:10:06.629ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59458
27112025-01-17T08:10:06.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59458 req_id = 4565e756-440e-4ed5-9d24-8c9b424d3493 response_code = 200 uri = /vpc-routes
27122025-01-17T08:10:06.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
27132025-01-17T08:10:06.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59458 req_id = d8792eff-8a3e-45bf-b4f2-472b59ba0622 response_code = 204 uri = /eip-gateways
27142025-01-17T08:10:06.702ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59458 req_id = 8657f6e3-1b79-4d30-a775-5fed7c8600cb response_code = 204 uri = /vpc-routes
27152025-01-17T08:10:06.744ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56721
27162025-01-17T08:10:06.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56721 req_id = 0522d47d-4805-4c7f-b108-f49df3fed063 response_code = 200 uri = /vpc-routes
27172025-01-17T08:10:06.758ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
27182025-01-17T08:10:06.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56721 req_id = 508b02cf-3c7c-4426-a763-2fee9bfd9631 response_code = 204 uri = /eip-gateways
27192025-01-17T08:10:06.763ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41324
27202025-01-17T08:10:06.764ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41324 req_id = 78a267cf-8d29-470b-ac3e-40db9943ff64 response_code = 200 uri = /v2p
27212025-01-17T08:10:06.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38325
27222025-01-17T08:10:06.771ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38325 req_id = 11de87e8-680f-49ff-ad32-f6bbec74202d response_code = 200 uri = /v2p
27232025-01-17T08:10:06.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56721 req_id = f130fdaf-f0d5-48b1-a142-a866e33eeaec response_code = 204 uri = /vpc-routes
27242025-01-17T08:10:06.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52800
27252025-01-17T08:10:06.821ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27262025-01-17T08:10:06.865ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27272025-01-17T08:10:06.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112321 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52800 req_id = b3a0ab13-f94e-4ccf-aa66-b6944f8190a2 response_code = 204 uri = /switch-ports
27282025-01-17T08:10:06.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41154
27292025-01-17T08:10:06.934ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42827
27302025-01-17T08:10:06.934ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27312025-01-17T08:10:06.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4036 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52800 req_id = 2f53d6f1-bb3d-4ab5-9a3c-a019b7319f97 response_code = 200 uri = /network-bootstore-config
27322025-01-17T08:10:06.938ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4056 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41154 req_id = 8ef2d75f-d970-4da4-ac73-f27aa90f09a6 response_code = 200 uri = /v2p
27332025-01-17T08:10:06.953ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59101
27342025-01-17T08:10:06.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59101 req_id = 4215b94e-7222-4118-916b-a612beb3ddb0 response_code = 200 uri = /vpc-routes
27352025-01-17T08:10:06.966ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
27362025-01-17T08:10:06.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59101 req_id = 5bbcdc29-f628-446b-97c7-b6a4682ec7c2 response_code = 204 uri = /eip-gateways
27372025-01-17T08:10:06.973ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27382025-01-17T08:10:06.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 916 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59101 req_id = 7934f27a-4fa8-40a6-9b30-a9f5e204adcf response_code = 204 uri = /vpc-routes
27392025-01-17T08:10:07.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98774 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42827 req_id = f6b1ddf8-e5e0-4a00-bc02-a7227f8987b8 response_code = 204 uri = /switch-ports
27402025-01-17T08:10:07.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42827 req_id = c7a87f74-7cd6-4d36-8e88-66bb6b13f090 response_code = 200 uri = /network-bootstore-config
27412025-01-17T08:10:07.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36134
27422025-01-17T08:10:07.089ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27432025-01-17T08:10:07.124ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27442025-01-17T08:10:07.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36134 req_id = 15f1c43a-3f23-4de5-9d33-7d37febde12b response_code = 204 uri = /switch-ports
27452025-01-17T08:10:07.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36134 req_id = 7c220d8c-2066-4795-a0b6-40eb74dd1c27 response_code = 200 uri = /network-bootstore-config
27462025-01-17T08:10:18.096ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65455
27472025-01-17T08:10:18.096ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65455 req_id = cc0bc5b6-f741-4c3d-b4f0-9c37e5270b27 response_code = 200 uri = /baseboard
27482025-01-17T08:10:21.764ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7337 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = ec6ecada-fb44-436b-93dd-6c0bda651875 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
27492025-01-17T08:10:36.752ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38790
27502025-01-17T08:10:36.753ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38790 req_id = f7348f60-b5da-4eb6-9828-bf2315e06da3 response_code = 200 uri = /vpc-routes
27512025-01-17T08:10:36.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
27522025-01-17T08:10:36.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38790 req_id = e24f3588-8461-466a-8534-d18d2cce93e2 response_code = 204 uri = /eip-gateways
27532025-01-17T08:10:36.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38790 req_id = 3f636ac5-a80b-4f8d-8c48-bf6dea2fdb43 response_code = 204 uri = /vpc-routes
27542025-01-17T08:10:36.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54927
27552025-01-17T08:10:36.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54927 req_id = a0c1485f-1bc8-4892-9cba-9a2eb0538c15 response_code = 200 uri = /vpc-routes
27562025-01-17T08:10:37.015ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
27572025-01-17T08:10:37.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54927 req_id = 8ab8f972-c81c-4849-83ab-dff24b6ad1e7 response_code = 204 uri = /eip-gateways
27582025-01-17T08:10:37.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54927 req_id = 0918d391-aea4-43b8-8380-f913c046980c response_code = 204 uri = /vpc-routes
27592025-01-17T08:10:37.085ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40933
27602025-01-17T08:10:37.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40933 req_id = 4122a48d-f200-41a7-95fd-86d476a77b89 response_code = 200 uri = /vpc-routes
27612025-01-17T08:10:37.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60944
27622025-01-17T08:10:37.101ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27632025-01-17T08:10:37.101ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27642025-01-17T08:10:37.101ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
27652025-01-17T08:10:37.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
27662025-01-17T08:10:37.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40933 req_id = 70883400-45d1-42e5-93e2-1506317d0937 response_code = 204 uri = /eip-gateways
27672025-01-17T08:10:37.102ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
27682025-01-17T08:10:37.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 424 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40933 req_id = 3f22da57-fb23-4ac8-91f0-b5e070b9b57d response_code = 204 uri = /vpc-routes
27692025-01-17T08:10:37.117ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27702025-01-17T08:10:37.117ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9813f791-8da3-471c-9021-42fd85d77240
27712025-01-17T08:10:37.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46328
27722025-01-17T08:10:37.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46328 req_id = d68b6f28-751a-4cc5-a72c-90324db7b7bd response_code = 200 uri = /v2p
27732025-01-17T08:10:37.126ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37681
27742025-01-17T08:10:37.126ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27752025-01-17T08:10:37.146ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27762025-01-17T08:10:37.146ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_03539269-b412-4961-92af-cf162b13a30f
27772025-01-17T08:10:37.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33056
27782025-01-17T08:10:37.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58074
27792025-01-17T08:10:37.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48141
27802025-01-17T08:10:37.168ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27812025-01-17T08:10:37.168ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27822025-01-17T08:10:37.168ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
27832025-01-17T08:10:37.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 399 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48141 req_id = 1fc73c75-a26c-421d-b155-045c3cfc819b response_code = 200 uri = /v2p
27842025-01-17T08:10:37.168ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
27852025-01-17T08:10:37.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27862025-01-17T08:10:37.177ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27872025-01-17T08:10:37.177ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256
27882025-01-17T08:10:37.192ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27892025-01-17T08:10:37.192ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9813f791-8da3-471c-9021-42fd85d77240
27902025-01-17T08:10:37.218ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27912025-01-17T08:10:37.218ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_03539269-b412-4961-92af-cf162b13a30f
27922025-01-17T08:10:37.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40998
27932025-01-17T08:10:37.231ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27942025-01-17T08:10:37.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27952025-01-17T08:10:37.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27962025-01-17T08:10:37.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27972025-01-17T08:10:37.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27982025-01-17T08:10:37.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27992025-01-17T08:10:37.231ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28002025-01-17T08:10:37.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40998 req_id = 2a2c4df6-f16b-40df-b8ff-a48cdb1f72dd response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28012025-01-17T08:10:37.232ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28022025-01-17T08:10:37.232ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5
28032025-01-17T08:10:37.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28042025-01-17T08:10:37.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118265 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37681 req_id = 02aa9862-1dea-4b15-899b-f01e7d81740f response_code = 204 uri = /switch-ports
28052025-01-17T08:10:37.245ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37681 req_id = 21713794-7a87-4c0f-9585-d7fa46295351 response_code = 200 uri = /network-bootstore-config
28062025-01-17T08:10:37.249ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28072025-01-17T08:10:37.250ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256
28082025-01-17T08:10:37.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59980
28092025-01-17T08:10:37.260ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28102025-01-17T08:10:37.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28112025-01-17T08:10:37.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28122025-01-17T08:10:37.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28132025-01-17T08:10:37.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28142025-01-17T08:10:37.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28152025-01-17T08:10:37.260ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28162025-01-17T08:10:37.260ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 753 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59980 req_id = 5319bb12-7821-4182-858d-758986db7912 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28172025-01-17T08:10:37.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46296
28182025-01-17T08:10:37.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46296 req_id = 82370fc3-3a49-4699-8087-f231b5c133b5 response_code = 200 uri = /v2p
28192025-01-17T08:10:37.266ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28202025-01-17T08:10:37.266ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_11fc8969-6569-4e63-b863-6b5f04571d1f
28212025-01-17T08:10:37.284ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28222025-01-17T08:10:37.294ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28232025-01-17T08:10:37.294ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb743880-ceb4-4309-9fe1-855954a7a059
28242025-01-17T08:10:37.300ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37781
28252025-01-17T08:10:37.310ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28262025-01-17T08:10:37.310ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5
28272025-01-17T08:10:37.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28282025-01-17T08:10:37.325ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28292025-01-17T08:10:37.325ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/config/omicron-zones.json file = common/src/ledger.rs:177
28302025-01-17T08:10:37.328ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28312025-01-17T08:10:37.328ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24cecd51-2313-4198-99e2-aa6943e55b03
28322025-01-17T08:10:37.334ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/config/omicron-zones.json file = common/src/ledger.rs:177
28332025-01-17T08:10:37.342ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54573
28342025-01-17T08:10:37.343ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28352025-01-17T08:10:37.343ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_11fc8969-6569-4e63-b863-6b5f04571d1f
28362025-01-17T08:10:37.357ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9813f791-8da3-471c-9021-42fd85d77240 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28372025-01-17T08:10:37.357ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9813f791-8da3-471c-9021-42fd85d77240
28382025-01-17T08:10:37.360ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28392025-01-17T08:10:37.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58074 req_id = 12c1945e-e816-491c-8c8f-32e07fe8002e response_code = 204 uri = /switch-ports
28402025-01-17T08:10:37.369ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4312 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58074 req_id = 819af8b2-5a57-4580-ae6d-e287dbf94116 response_code = 200 uri = /network-bootstore-config
28412025-01-17T08:10:37.375ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28422025-01-17T08:10:37.375ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf
28432025-01-17T08:10:37.391ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 03539269-b412-4961-92af-cf162b13a30f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28442025-01-17T08:10:37.391ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_03539269-b412-4961-92af-cf162b13a30f
28452025-01-17T08:10:37.404ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28462025-01-17T08:10:37.404ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb743880-ceb4-4309-9fe1-855954a7a059
28472025-01-17T08:10:37.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28482025-01-17T08:10:37.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33560
28492025-01-17T08:10:37.416ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: c44c5780-e7d0-4a14-b3fa-2b1fe059d6b4, kind: Service { id: 7091f564-4da9-4862-bb09-767c6ad5168d }, name: Name("external-dns-7091f564-4da9-4862-bb09-767c6ad5168d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 255, 73])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d42e2397-5dea-44a5-a659-354fbca47fe1, kind: Service { id: 0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef }, name: Name("external-dns-0524cd29-2d0e-40dd-8bc1-e2ee65cf50ef"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 221, 209])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 67cd6822-7219-4b85-b9dc-2eb92b0b184d, kind: Service { id: 77fdb2fd-00ad-4d10-91e0-bc5591029bb2 }, name: Name("nexus-77fdb2fd-00ad-4d10-91e0-bc5591029bb2"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 141])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f1061304-35a5-4a5d-8720-d24c3602e83f, kind: Service { id: 3a7d06b4-6a4a-4656-9993-8071e5a7d047 }, name: Name("nexus-3a7d06b4-6a4a-4656-9993-8071e5a7d047"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 133, 241])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: ffe29852-03be-4c6e-bae0-48a120865968, kind: Service { id: 9182b5db-6831-43c9-bb90-36b92e1f25ff }, name: Name("nexus-9182b5db-6831-43c9-bb90-36b92e1f25ff"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 230, 25])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28502025-01-17T08:10:37.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28512025-01-17T08:10:37.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28522025-01-17T08:10:37.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28532025-01-17T08:10:37.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28542025-01-17T08:10:37.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28552025-01-17T08:10:37.416ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28562025-01-17T08:10:37.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 679 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33560 req_id = ee18cb3e-2fbd-4c5b-b2a4-37f5fb366160 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28572025-01-17T08:10:37.426ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28582025-01-17T08:10:37.426ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22491af9-677c-492c-b09f-dd32d6d37612
28592025-01-17T08:10:37.444ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4fd1876a-b1b7-4eaf-bb3f-62cedcf08256 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28602025-01-17T08:10:37.444ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4fd1876a-b1b7-4eaf-bb3f-62cedcf08256
28612025-01-17T08:10:37.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 351407 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60944 req_id = 67803d5f-3d56-4f30-b1c1-61b12d377f7b response_code = 200 uri = /inventory
28622025-01-17T08:10:37.458ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28632025-01-17T08:10:37.458ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24cecd51-2313-4198-99e2-aa6943e55b03
28642025-01-17T08:10:37.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134245 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54573 req_id = 40e0e3ee-da8b-47ec-ac95-919b417e117f response_code = 204 uri = /switch-ports
28652025-01-17T08:10:37.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 899 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54573 req_id = 85192829-7d0f-4117-b07d-2fea7504ac5e response_code = 200 uri = /network-bootstore-config
28662025-01-17T08:10:37.485ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28672025-01-17T08:10:37.485ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf
28682025-01-17T08:10:37.497ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 615e1276-ba9d-48e1-a40b-a89a9df56fd5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28692025-01-17T08:10:37.497ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_615e1276-ba9d-48e1-a40b-a89a9df56fd5
28702025-01-17T08:10:37.511ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28712025-01-17T08:10:37.512ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22491af9-677c-492c-b09f-dd32d6d37612
28722025-01-17T08:10:37.527ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 11fc8969-6569-4e63-b863-6b5f04571d1f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28732025-01-17T08:10:37.527ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_11fc8969-6569-4e63-b863-6b5f04571d1f
28742025-01-17T08:10:37.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 376295 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33056 req_id = ac7726f8-8524-4ca0-aa73-64ccd7451281 response_code = 200 uri = /inventory
28752025-01-17T08:10:37.549ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fb743880-ceb4-4309-9fe1-855954a7a059 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28762025-01-17T08:10:37.549ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fb743880-ceb4-4309-9fe1-855954a7a059
28772025-01-17T08:10:37.572ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 24cecd51-2313-4198-99e2-aa6943e55b03 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28782025-01-17T08:10:37.572ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_24cecd51-2313-4198-99e2-aa6943e55b03
28792025-01-17T08:10:37.595ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 79ab89f7-7928-4766-99f1-7a0e584c7fdf (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28802025-01-17T08:10:37.595ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_79ab89f7-7928-4766-99f1-7a0e584c7fdf
28812025-01-17T08:10:37.618ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 22491af9-677c-492c-b09f-dd32d6d37612 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
28822025-01-17T08:10:37.618ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_22491af9-677c-492c-b09f-dd32d6d37612
28832025-01-17T08:10:37.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 332570 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37781 req_id = b8977753-4d34-4a41-84d7-9fcf38b7af16 response_code = 200 uri = /inventory
28842025-01-17T08:10:48.130ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40290
28852025-01-17T08:10:48.130ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40290 req_id = c06dec7d-1d1d-4679-9d26-d2efba6b39b7 response_code = 200 uri = /baseboard
28862025-01-17T08:10:51.764ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7341 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = a7559005-a7db-4fa1-9552-e80928ec91ec response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
28872025-01-17T08:11:06.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44101
28882025-01-17T08:11:06.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44101 req_id = b956f09a-0ae1-4789-acbc-b9635d6d629c response_code = 200 uri = /vpc-routes
28892025-01-17T08:11:06.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42288
28902025-01-17T08:11:06.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42288 req_id = 44a15545-1f81-490d-9735-c97337aa2d0f response_code = 200 uri = /vpc-routes
28912025-01-17T08:11:06.832ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
28922025-01-17T08:11:06.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44101 req_id = 55f45ffa-eba6-4c82-a8ff-b3abfb4b5762 response_code = 204 uri = /eip-gateways
28932025-01-17T08:11:06.833ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
28942025-01-17T08:11:06.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42288 req_id = ed4fed95-ac73-41ef-96f0-b960e9471840 response_code = 204 uri = /eip-gateways
28952025-01-17T08:11:06.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44101 req_id = 73cbc6ad-4197-4d04-bdca-1ad11bd63244 response_code = 204 uri = /vpc-routes
28962025-01-17T08:11:06.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54754
28972025-01-17T08:11:06.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54754 req_id = dc6712da-97d1-4f62-8a71-164a38086c9c response_code = 200 uri = /v2p
28982025-01-17T08:11:06.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42288 req_id = 24b8d68c-07eb-4f50-965e-4f087abc8952 response_code = 204 uri = /vpc-routes
28992025-01-17T08:11:06.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65521
29002025-01-17T08:11:06.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65521 req_id = 465ceeff-b378-4829-aa0b-c72232b542a1 response_code = 200 uri = /v2p
29012025-01-17T08:11:06.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45951
29022025-01-17T08:11:06.892ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29032025-01-17T08:11:06.936ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29042025-01-17T08:11:06.994ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102138 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:45951 req_id = f9233752-9358-4758-881e-f19d1ceed07c response_code = 204 uri = /switch-ports
29052025-01-17T08:11:06.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38045
29062025-01-17T08:11:06.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29072025-01-17T08:11:06.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45951 req_id = 8c9e71df-f994-4ce1-90da-a6d1e5f91e9b response_code = 200 uri = /network-bootstore-config
29082025-01-17T08:11:07.031ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29092025-01-17T08:11:07.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39109
29102025-01-17T08:11:07.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39109 req_id = 3cc97dad-0bd6-4933-9567-743ac4bbd041 response_code = 200 uri = /vpc-routes
29112025-01-17T08:11:07.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93081 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38045 req_id = ad57bacd-019d-40a3-a5a1-c7a6144e18fa response_code = 204 uri = /switch-ports
29122025-01-17T08:11:07.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38045 req_id = 81fe381e-5f4f-4e14-8f0c-d9b39d7de916 response_code = 200 uri = /network-bootstore-config
29132025-01-17T08:11:07.104ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
29142025-01-17T08:11:07.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39109 req_id = 572a0cf1-ef00-4f43-a281-a8b536ade269 response_code = 204 uri = /eip-gateways
29152025-01-17T08:11:07.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39109 req_id = 56bdaa8f-f87b-4fd3-bd17-dce5fe221073 response_code = 204 uri = /vpc-routes
29162025-01-17T08:11:07.114ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64398
29172025-01-17T08:11:07.114ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29182025-01-17T08:11:07.153ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29192025-01-17T08:11:07.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97959 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64398 req_id = 6946bc2f-fd5e-4e17-bc57-79d9da9a8384 response_code = 204 uri = /switch-ports
29202025-01-17T08:11:07.212ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57905
29212025-01-17T08:11:07.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64398 req_id = c5ee1f55-1085-48ed-9e3a-7fa0f6629338 response_code = 200 uri = /network-bootstore-config
29222025-01-17T08:11:07.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57905 req_id = db2ba273-67ba-42b0-8f71-9671a858d613 response_code = 200 uri = /v2p
29232025-01-17T08:11:18.165ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33364
29242025-01-17T08:11:18.165ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33364 req_id = 2f5eaa43-23eb-44da-bb4d-0ea1e64e09c2 response_code = 200 uri = /baseboard
29252025-01-17T08:11:21.765ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7516 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = 03689664-4a9b-4c65-aa09-63bb00978889 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
29262025-01-17T08:11:36.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46817
29272025-01-17T08:11:36.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46817 req_id = 6345cf59-7f5f-491f-815d-7f0df0be7a68 response_code = 200 uri = /vpc-routes
29282025-01-17T08:11:36.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42773
29292025-01-17T08:11:36.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42773 req_id = 3ca7779e-2d44-4463-b06b-9d2dc23dd6a4 response_code = 200 uri = /vpc-routes
29302025-01-17T08:11:36.902ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
29312025-01-17T08:11:36.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46817 req_id = 456f78e9-6cb4-4470-949e-051b603468a4 response_code = 204 uri = /eip-gateways
29322025-01-17T08:11:36.911ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
29332025-01-17T08:11:36.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42773 req_id = 22305d6d-125b-42d9-bebb-d3eeabd753cc response_code = 204 uri = /eip-gateways
29342025-01-17T08:11:36.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52959
29352025-01-17T08:11:36.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52959 req_id = adf2bc51-8e22-4720-8e8d-cbe1f00650b5 response_code = 200 uri = /v2p
29362025-01-17T08:11:36.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42773 req_id = 40c34e96-7b8f-4b08-a592-c42c33cd30a7 response_code = 204 uri = /vpc-routes
29372025-01-17T08:11:37.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46297
29382025-01-17T08:11:37.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46297 req_id = 1890fbe2-dadc-43ba-978d-ca1e245c27aa response_code = 200 uri = /vpc-routes
29392025-01-17T08:11:37.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43576
29402025-01-17T08:11:37.021ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43576 req_id = 039750fc-c3b0-4804-a225-27ea7a301717 response_code = 200 uri = /v2p
29412025-01-17T08:11:37.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46817 req_id = b453d550-3cb9-4f17-bc75-6989ed5e9ede response_code = 204 uri = /vpc-routes
29422025-01-17T08:11:37.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39050
29432025-01-17T08:11:37.058ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29442025-01-17T08:11:37.110ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29452025-01-17T08:11:37.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114749 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39050 req_id = 19b1a8cd-feab-424d-b20f-993b49b11c00 response_code = 204 uri = /switch-ports
29462025-01-17T08:11:37.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43234
29472025-01-17T08:11:37.173ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33328
29482025-01-17T08:11:37.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39050 req_id = b0e95144-1ee8-4ad1-940f-88c76153fd1d response_code = 200 uri = /network-bootstore-config
29492025-01-17T08:11:37.173ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29502025-01-17T08:11:37.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33328 req_id = a5d284dd-f3cd-4246-96d9-f53a0ea09aa5 response_code = 200 uri = /v2p
29512025-01-17T08:11:37.178ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
29522025-01-17T08:11:37.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5629 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46297 req_id = 06a6fa80-69c6-4242-89d6-54e028a588c3 response_code = 204 uri = /eip-gateways
29532025-01-17T08:11:37.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1011 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46297 req_id = 9380866e-3d4b-4e5c-a0ee-4fe443c249a4 response_code = 204 uri = /vpc-routes
29542025-01-17T08:11:37.212ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29552025-01-17T08:11:37.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94618 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43234 req_id = 542042ab-4353-44e8-ad8f-b36c1bdd715a response_code = 204 uri = /switch-ports
29562025-01-17T08:11:37.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43234 req_id = b76bf52c-2db8-4d45-be72-b380ffe2b786 response_code = 200 uri = /network-bootstore-config
29572025-01-17T08:11:37.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58747
29582025-01-17T08:11:37.319ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29592025-01-17T08:11:37.354ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29602025-01-17T08:11:37.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89614 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58747 req_id = 2b2445f3-86d5-4879-909b-68c2aa32d6ee response_code = 204 uri = /switch-ports
29612025-01-17T08:11:37.411ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58747 req_id = 4b89b63e-8d3f-485f-bf8a-5375c12f4684 response_code = 200 uri = /network-bootstore-config
29622025-01-17T08:11:48.200ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52895
29632025-01-17T08:11:48.201ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:52895 req_id = 6cfd9507-d66b-4361-b002-d44fa59aeb82 response_code = 200 uri = /baseboard
29642025-01-17T08:11:51.765ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7394 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = de599f96-80b0-43dc-b1a2-30313f0e1424 response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
29652025-01-17T08:12:06.646ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43826
29662025-01-17T08:12:06.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43826 req_id = c45fbf73-9169-4dee-9d08-9f9c330a9008 response_code = 200 uri = /vpc-routes
29672025-01-17T08:12:06.698ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
29682025-01-17T08:12:06.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43826 req_id = fff211b4-392b-497c-af76-9b6b27b12311 response_code = 204 uri = /eip-gateways
29692025-01-17T08:12:06.709ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43826 req_id = 0fc4697d-ab8b-4c15-88aa-05ec0517a249 response_code = 204 uri = /vpc-routes
29702025-01-17T08:12:06.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65228
29712025-01-17T08:12:06.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65228 req_id = 581e9242-2dc0-41d3-b38e-f252b4f5abac response_code = 200 uri = /v2p
29722025-01-17T08:12:06.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51370
29732025-01-17T08:12:06.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51370 req_id = 4dd12ff1-e6df-40bb-b978-01b290b7a451 response_code = 200 uri = /vpc-routes
29742025-01-17T08:12:06.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58549
29752025-01-17T08:12:06.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58549 req_id = ed72ba28-ad19-46e1-8645-f6010a3d4079 response_code = 200 uri = /v2p
29762025-01-17T08:12:06.840ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51341
29772025-01-17T08:12:06.840ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29782025-01-17T08:12:06.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29792025-01-17T08:12:06.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99932 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51341 req_id = 7991f338-41d2-42d8-8d85-ec638ff83d67 response_code = 204 uri = /switch-ports
29802025-01-17T08:12:06.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61644
29812025-01-17T08:12:06.940ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
29822025-01-17T08:12:06.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51370 req_id = eb318bc3-ce6d-4e5b-ad12-6b49d7a2890a response_code = 204 uri = /eip-gateways
29832025-01-17T08:12:06.940ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51341 req_id = 1a683d94-76b3-46e8-b4e4-6a5c1c403bc5 response_code = 200 uri = /network-bootstore-config
29842025-01-17T08:12:06.940ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29852025-01-17T08:12:06.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 416 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51370 req_id = c7dcd368-97f9-4e8e-9392-02a9ccaea871 response_code = 204 uri = /vpc-routes
29862025-01-17T08:12:06.976ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29872025-01-17T08:12:06.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51907
29882025-01-17T08:12:06.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51907 req_id = d64a7575-f67d-43a0-81ce-6442f374051b response_code = 200 uri = /vpc-routes
29892025-01-17T08:12:07.002ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62339
29902025-01-17T08:12:07.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62339 req_id = e1e9565a-6b40-4d4e-b6c7-5f1fae798a5d response_code = 200 uri = /v2p
29912025-01-17T08:12:07.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61644 req_id = 51e882ac-2bd8-4d40-86ea-feec14918ac9 response_code = 204 uri = /switch-ports
29922025-01-17T08:12:07.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61644 req_id = cdf6859b-376a-4f1c-aecc-c02a668cfa3c response_code = 200 uri = /network-bootstore-config
29932025-01-17T08:12:07.040ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
29942025-01-17T08:12:07.040ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51907 req_id = 10b25cdf-0f6a-410b-9472-aebcf30a4fe9 response_code = 204 uri = /eip-gateways
29952025-01-17T08:12:07.049ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51907 req_id = dc1fdc3f-3048-46cc-ad3d-69fe21b604e2 response_code = 204 uri = /vpc-routes
29962025-01-17T08:12:07.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61655
29972025-01-17T08:12:07.070ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
29982025-01-17T08:12:07.107ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
29992025-01-17T08:12:07.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61655 req_id = 2104f18e-ae08-433c-baa8-d885ab6e1045 response_code = 204 uri = /switch-ports
30002025-01-17T08:12:07.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61655 req_id = 7bcdb686-d7db-475a-b04d-065902f07e34 response_code = 200 uri = /network-bootstore-config
30012025-01-17T08:12:18.235ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59943
30022025-01-17T08:12:18.235ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59943 req_id = 778b2d49-7dcc-4b11-ab41-138115ebd212 response_code = 200 uri = /baseboard
30032025-01-17T08:12:18.554ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33958
30042025-01-17T08:12:18.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33958 req_id = 5030e268-cc08-446f-83f5-5825425ea9bd response_code = 200 uri = /v2p
30052025-01-17T08:12:18.555ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(15900858) }
30062025-01-17T08:12:18.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33958 req_id = 3a13d1ca-0936-460c-bbd3-be0f2bcda3c9 response_code = 204 uri = /v2p
30072025-01-17T08:12:18.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63428
30082025-01-17T08:12:18.731ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: b7ec59f8-c58e-4b54-b8eb-5c329993f1ff, kind: Instance { id: ddc7efac-b990-45b2-a06b-6c2590cb408e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15900858), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b7ec59f8-c58e-4b54-b8eb-5c329993f1ff, kind: Instance { id: ddc7efac-b990-45b2-a06b-6c2590cb408e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15900858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b7ec59f8-c58e-4b54-b8eb-5c329993f1ff, kind: Instance { id: ddc7efac-b990-45b2-a06b-6c2590cb408e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15900858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15900858))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b7ec59f8-c58e-4b54-b8eb-5c329993f1ff, kind: Instance { id: ddc7efac-b990-45b2-a06b-6c2590cb408e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15900858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: b7a22aa0-5405-409d-8861-598547b6ea0a, slot: 0, read_only: false, vcr_json: .., name: "disk-4bec32bb3da" }], boot_settings: Some(InstanceBootSettings { order: [b7a22aa0-5405-409d-8861-598547b6ea0a] }), cloud_init_bytes: Some(..) } instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e metadata = InstanceMetadata { silo_id: 29a01125-d8e0-4865-bad8-a8c041fc83f3, project_id: b8161237-4e01-4ce3-8c2b-241efd7916b5 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-17T08:12:18.725992995Z }
30092025-01-17T08:12:18.731ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e migration_id = None propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30102025-01-17T08:12:18.732ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e migration_id = None propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: b7ec59f8-c58e-4b54-b8eb-5c329993f1ff, kind: Instance { id: ddc7efac-b990-45b2-a06b-6c2590cb408e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15900858), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b7ec59f8-c58e-4b54-b8eb-5c329993f1ff, kind: Instance { id: ddc7efac-b990-45b2-a06b-6c2590cb408e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15900858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b7ec59f8-c58e-4b54-b8eb-5c329993f1ff, kind: Instance { id: ddc7efac-b990-45b2-a06b-6c2590cb408e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15900858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(15900858))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: b7ec59f8-c58e-4b54-b8eb-5c329993f1ff, kind: Instance { id: ddc7efac-b990-45b2-a06b-6c2590cb408e }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(15900858), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: b7a22aa0-5405-409d-8861-598547b6ea0a, slot: 0, read_only: false, vcr_json: .., name: "disk-4bec32bb3da" }], boot_settings: Some(InstanceBootSettings { order: [b7a22aa0-5405-409d-8861-598547b6ea0a] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-17T08:12:18.725992995Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
30112025-01-17T08:12:18.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9216 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63428 req_id = a14fec2d-8904-4a2a-af23-a097011049ff response_code = 200 uri = /vmms/547f3e16-5fda-4120-a7eb-322190e65c41
30122025-01-17T08:12:18.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58890
30132025-01-17T08:12:18.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 779 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58890 req_id = 4fcff84b-0816-44a3-bb2b-a4d8b53f75f1 response_code = 200 uri = /vmms/547f3e16-5fda-4120-a7eb-322190e65c41/state
30142025-01-17T08:12:18.823ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 15900858 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
30152025-01-17T08:12:18.823ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30162025-01-17T08:12:18.861ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41 file = illumos-utils/src/zone.rs:325 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30172025-01-17T08:12:18.884ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41 file = illumos-utils/src/zone.rs:363 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30182025-01-17T08:12:18.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55810
30192025-01-17T08:12:18.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55810 req_id = 3f5672c5-2336-4729-9fa9-8db858279077 response_code = 200 uri = /vpc-routes
30202025-01-17T08:12:18.914ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {b7ec59f8-c58e-4b54-b8eb-5c329993f1ff: {10.151.1.175: {90310410-df23-4f58-bc8d-d88e8177b0d1}, 10.151.1.176: {90310410-df23-4f58-bc8d-d88e8177b0d1}}} }
30212025-01-17T08:12:20.554ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30222025-01-17T08:12:20.555ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41 zone file = illumos-utils/src/running_zone.rs:488 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30232025-01-17T08:12:20.728ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 52.625274ms file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30242025-01-17T08:12:20.791ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 68.48024ms file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30252025-01-17T08:12:20.873ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 183.526267ms file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30262025-01-17T08:12:21.074ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 531.651954ms file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30272025-01-17T08:12:21.619ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 1.083692149s file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30282025-01-17T08:12:21.768ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10040 local_addr = [fd00:1122:3344:101::1]:48080 method = GET remote_addr = [fd00:1122:3344:101::d]:44914 req_id = c3b9d48b-6d87-4e91-bc4a-92c2d378ecdf response_code = 200 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad uri = /d7936c62-666e-4e9a-9d0d-121ba64013ad
30292025-01-17T08:12:22.715ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 563.149951ms file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30302025-01-17T08:12:23.290ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 680.793053ms file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30312025-01-17T08:12:23.983ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 1.241893248s file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30322025-01-17T08:12:25.235ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 985.403361ms file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 zone = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30332025-01-17T08:12:26.250ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41 file = sled-agent/src/instance.rs:2068 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30342025-01-17T08:12:26.259ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41") failed: Property not found. retry in 65.016644ms file = illumos-utils/src/svc.rs:42 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30352025-01-17T08:12:26.334ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30362025-01-17T08:12:26.373ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30372025-01-17T08:12:26.514ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30382025-01-17T08:12:26.515ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
30392025-01-17T08:12:26.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7600552 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55810 req_id = a3e87c8b-f536-4ad2-ac9e-bb923f3c585a response_code = 204 uri = /eip-gateways
30402025-01-17T08:12:26.516ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-17T08:12:26.515347398Z } file = sled-agent/src/instance.rs:781 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30412025-01-17T08:12:26.516ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-17T08:12:26.515347398Z } propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30422025-01-17T08:12:26.516ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-17T08:12:26.515347398Z }, migration_in: None, migration_out: None }
30432025-01-17T08:12:26.550ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-17T08:12:26.550579194Z } file = sled-agent/src/instance.rs:781 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30442025-01-17T08:12:26.550ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-17T08:12:26.550579194Z } propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30452025-01-17T08:12:26.550ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-17T08:12:26.550579194Z }, migration_in: None, migration_out: None }
30462025-01-17T08:12:26.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 518 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55810 req_id = c5ef5115-6f1f-4489-920b-ab16ead05955 response_code = 204 uri = /vpc-routes
30472025-01-17T08:12:36.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58852
30482025-01-17T08:12:36.327ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1565 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58852 req_id = ca765dd0-f4db-43b7-9fca-dc410ad3287f response_code = 200 uri = /vmms/547f3e16-5fda-4120-a7eb-322190e65c41/state
30492025-01-17T08:12:36.327ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-17T08:12:36.327121709Z } file = sled-agent/src/instance.rs:781 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30502025-01-17T08:12:36.327ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-17T08:12:36.327121709Z } propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30512025-01-17T08:12:36.327ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-17T08:12:36.327121709Z }, migration_in: None, migration_out: None }
30522025-01-17T08:12:36.335ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-17T08:12:36.335848914Z } file = sled-agent/src/instance.rs:781 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30532025-01-17T08:12:36.335ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-17T08:12:36.335848914Z } propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30542025-01-17T08:12:36.335ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30552025-01-17T08:12:36.335ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30562025-01-17T08:12:36.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
30572025-01-17T08:12:36.337ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/37794d2e-e14b-4ced-a139-272d5ed64db4/debug/bundle/zone", "/pool/int/fe1f35c4-7f25-4d50-ace9-b812bb03baba/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/9813f791-8da3-471c-9021-42fd85d77240/crypt/debug", "/pool/ext/03539269-b412-4961-92af-cf162b13a30f/crypt/debug", "/pool/ext/4fd1876a-b1b7-4eaf-bb3f-62cedcf08256/crypt/debug", "/pool/ext/615e1276-ba9d-48e1-a40b-a89a9df56fd5/crypt/debug", "/pool/ext/11fc8969-6569-4e63-b863-6b5f04571d1f/crypt/debug", "/pool/ext/fb743880-ceb4-4309-9fe1-855954a7a059/crypt/debug", "/pool/ext/24cecd51-2313-4198-99e2-aa6943e55b03/crypt/debug", "/pool/ext/79ab89f7-7928-4766-99f1-7a0e584c7fdf/crypt/debug", "/pool/ext/22491af9-677c-492c-b09f-dd32d6d37612/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41
30582025-01-17T08:12:36.855ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46138
30592025-01-17T08:12:36.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46138 req_id = 4e19ae5a-a118-4984-b405-92d22343c5b7 response_code = 200 uri = /vpc-routes
30602025-01-17T08:12:36.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60961
30612025-01-17T08:12:36.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38176
30622025-01-17T08:12:37.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34095
30632025-01-17T08:12:37.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34095 req_id = d05b3221-f4af-4ed8-b6e9-8ec76d5be248 response_code = 200 uri = /vpc-routes
30642025-01-17T08:12:37.020ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53397
30652025-01-17T08:12:37.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53397 req_id = db05c833-3ec9-447e-b3a9-3091bd851ca5 response_code = 200 uri = /vpc-routes
30662025-01-17T08:12:37.093ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {b7ec59f8-c58e-4b54-b8eb-5c329993f1ff: {10.151.1.176: {90310410-df23-4f58-bc8d-d88e8177b0d1}, 10.151.1.175: {90310410-df23-4f58-bc8d-d88e8177b0d1}}} }
30672025-01-17T08:12:37.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34095 req_id = 985bd5a5-eeb8-4995-9c6e-15ff9d334385 response_code = 204 uri = /eip-gateways
30682025-01-17T08:12:37.093ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {b7ec59f8-c58e-4b54-b8eb-5c329993f1ff: {10.151.1.175: {90310410-df23-4f58-bc8d-d88e8177b0d1}, 10.151.1.176: {90310410-df23-4f58-bc8d-d88e8177b0d1}}} }
30692025-01-17T08:12:37.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46138 req_id = 35f6f127-7759-497d-8513-8f2b0e4620cb response_code = 204 uri = /eip-gateways
30702025-01-17T08:12:37.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {b7ec59f8-c58e-4b54-b8eb-5c329993f1ff: {10.151.1.176: {90310410-df23-4f58-bc8d-d88e8177b0d1}, 10.151.1.175: {90310410-df23-4f58-bc8d-d88e8177b0d1}}} }
30712025-01-17T08:12:37.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53397 req_id = b090e377-37d4-4b05-86a2-edeaaa06f861 response_code = 204 uri = /eip-gateways
30722025-01-17T08:12:37.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 897 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46138 req_id = 86890ce3-797e-426b-9394-eae15a367ea2 response_code = 204 uri = /vpc-routes
30732025-01-17T08:12:37.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34095 req_id = a8451599-5916-4e21-9e2f-20340ee2012a response_code = 204 uri = /vpc-routes
30742025-01-17T08:12:37.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53397 req_id = 18f4d47d-a494-4e55-8f29-5632b2b83516 response_code = 204 uri = /vpc-routes
30752025-01-17T08:12:37.177ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60691
30762025-01-17T08:12:37.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52298
30772025-01-17T08:12:37.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52298 req_id = 5f70e656-b44c-4006-9273-5643914700c2 response_code = 200 uri = /v2p
30782025-01-17T08:12:37.215ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63621
30792025-01-17T08:12:37.216ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
30802025-01-17T08:12:37.220ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41", bundle_id: 0235d802-45df-46e8-98d4-fe84c56b9721 }, time_created: 2025-01-17T08:12:36.338428371Z, version: 0, cause: TerminatedInstance }
30812025-01-17T08:12:37.221ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_547f3e16-5fda-4120-a7eb-322190e65c41 file = sled-agent/src/instance.rs:1314 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
30822025-01-17T08:12:37.258ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
30832025-01-17T08:12:37.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50411
30842025-01-17T08:12:37.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50411 req_id = a416d4c1-447f-4c9a-927c-153c1801226e response_code = 200 uri = /v2p
30852025-01-17T08:12:37.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50301
30862025-01-17T08:12:37.318ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
30872025-01-17T08:12:37.318ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102802 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63621 req_id = cd78bbc7-104f-4cd3-83ca-fbf2ddaa62a3 response_code = 204 uri = /switch-ports
30882025-01-17T08:12:37.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 726 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63621 req_id = 16cdd5f4-9302-42eb-b966-ff243190fe76 response_code = 200 uri = /network-bootstore-config
30892025-01-17T08:12:37.361ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
30902025-01-17T08:12:37.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57631
30912025-01-17T08:12:37.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57631 req_id = 11c75c8e-fa58-4f76-bc7c-92209007be4d response_code = 200 uri = /v2p
30922025-01-17T08:12:37.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 134809 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50301 req_id = c1aaf780-da89-4ea9-94c4-9a786b94556e response_code = 204 uri = /switch-ports
30932025-01-17T08:12:37.421ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50301 req_id = d1c4c37b-ef4a-40ad-b97f-a6763bbb7b1b response_code = 200 uri = /network-bootstore-config
30942025-01-17T08:12:37.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42217
30952025-01-17T08:12:37.473ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
30962025-01-17T08:12:37.507ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
30972025-01-17T08:12:37.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84942 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42217 req_id = bb03565c-db69-4570-b538-86a4123d53b0 response_code = 204 uri = /switch-ports
30982025-01-17T08:12:37.558ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42217 req_id = fe5cd410-82c7-4c42-bf1d-edcd031b06cb response_code = 200 uri = /network-bootstore-config
30992025-01-17T08:12:38.969ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
31002025-01-17T08:12:38.986ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(15900858), kind: System }
31012025-01-17T08:12:38.986ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(15900858), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
31022025-01-17T08:12:38.986ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T08:12:38.986509856Z }, migration_in: None, migration_out: None }
31032025-01-17T08:12:39.036ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T08:12:38.986509856Z }, migration_in: None, migration_out: None }
31042025-01-17T08:12:39.040ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = ddc7efac-b990-45b2-a06b-6c2590cb408e propolis_id = 547f3e16-5fda-4120-a7eb-322190e65c41
31052025-01-17T08:12:39.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2107917 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60961 req_id = ba9b32ed-a427-4749-9a8c-6009767e9237 response_code = 200 uri = /vmms/547f3e16-5fda-4120-a7eb-322190e65c41/state
31062025-01-17T08:12:39.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2082021 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38176 req_id = 2c0661b0-5cde-4f84-ab0e-9736ad060625 response_code = 200 uri = /vmms/547f3e16-5fda-4120-a7eb-322190e65c41/state
31072025-01-17T08:12:39.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1894342 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60691 req_id = d4420f10-6a59-4185-a23c-3161a262ff63 response_code = 200 uri = /vmms/547f3e16-5fda-4120-a7eb-322190e65c41/state
31082025-01-17T08:12:39.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52977
31092025-01-17T08:12:39.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52977 req_id = 36388038-5136-4f07-96db-f4a1b0067eeb response_code = 200 uri = /vpc-routes
31102025-01-17T08:12:39.460ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {b7ec59f8-c58e-4b54-b8eb-5c329993f1ff: {10.151.1.175: {90310410-df23-4f58-bc8d-d88e8177b0d1}, 10.151.1.176: {90310410-df23-4f58-bc8d-d88e8177b0d1}}} }
31112025-01-17T08:12:39.460ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52977 req_id = 7956f87b-abd9-4e0e-a205-4a29fef30dec response_code = 204 uri = /eip-gateways
31122025-01-17T08:12:39.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52977 req_id = f71e4adb-085e-41f0-af8c-2e063e327922 response_code = 204 uri = /vpc-routes
31132025-01-17T08:12:39.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35051
31142025-01-17T08:12:39.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35051 req_id = a4912052-3e25-4df1-a57e-734559609b5b response_code = 200 uri = /v2p
31152025-01-17T08:12:40.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63221
31162025-01-17T08:12:40.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63221 req_id = 35c4f0c9-d86f-4c4c-9ac2-505f3e29fb97 response_code = 200 uri = /v2p
31172025-01-17T08:12:40.392ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51457
31182025-01-17T08:12:40.392ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51457 req_id = d5ba164d-4bd3-46f4-9b70-9894750ea27d response_code = 200 uri = /vpc-routes
31192025-01-17T08:12:40.405ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
31202025-01-17T08:12:40.405ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad
31212025-01-17T08:12:40.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51457 req_id = 781df4be-2c5c-4b00-8659-ee397e499bba response_code = 204 uri = /eip-gateways
31222025-01-17T08:12:40.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51457 req_id = 9a53eded-d50b-4cd7-84c0-e60c5ba7de51 response_code = 204 uri = /vpc-routes
31232025-01-17T08:12:40.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59181
31242025-01-17T08:12:40.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59181 req_id = a9c7e84d-6647-40d0-b713-d5dc65b37f1c response_code = 200 uri = /vpc-routes
31252025-01-17T08:12:40.965ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = d7936c62-666e-4e9a-9d0d-121ba64013ad values = ExternalIpGatewayMap { mappings: {} }
31262025-01-17T08:12:40.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59181 req_id = bcb72366-fada-410c-a89a-ea77b465297c response_code = 204 uri = /eip-gateways
31272025-01-17T08:12:40.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59181 req_id = 8c940489-48aa-4828-8ba2-c1b9ba2f3134 response_code = 204 uri = /vpc-routes