Max level shown:
1 [ Jan 2 23:29:33 Enabled. ]
2 [ Jan 2 23:29:33 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 2 23:29:33 Method "start" exited with status 0. ]
4 [ Jan 2 23:29:33 Rereading configuration. ]
5 [ Jan 2 23:29:33 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-02T23:29:33.455ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-02T23:29:33.455ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-02T23:29:33.507ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-02T23:29:33.507ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-02T23:29:33.620ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-02T23:29:33.629ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-02T23:29:33.637ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-02T23:29:34.232ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:9fb2::, width: 64 }
152025-01-02T23:29:34.372ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-02T23:29:34.372ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-02T23:29:34.372ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-02T23:29:34.372ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
192025-01-02T23:29:34.372ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
202025-01-02T23:29:34.372ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-02T23:29:34.375ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "buskin", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-02T23:29:34.375ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-02T23:29:34.375ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-02T23:29:34.375ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-02T23:29:34.375ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-02T23:29:34.375ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-02T23:29:34.376ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
282025-01-02T23:29:34.376ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-02T23:29:34.376ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-02T23:29:34.387ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-02T23:29:34.387ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool)
322025-01-02T23:29:34.519ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal }
332025-01-02T23:29:35.080ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
342025-01-02T23:29:35.080ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-02T23:29:35.080ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-02T23:29:35.080ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-02T23:29:35.080ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
382025-01-02T23:29:35.080ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-02T23:29:35.080ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-02T23:29:35.089ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-02T23:29:35.089ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = e447c503-e3d7-466e-a61b-e086843a2be9 (zpool)
422025-01-02T23:29:35.199ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal }
432025-01-02T23:29:35.748ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-02T23:29:35.748ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-02T23:29:35.748ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
472025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482025-01-02T23:29:35.748ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-02T23:29:35.748ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-02T23:29:35.748ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
512025-01-02T23:29:35.748ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
522025-01-02T23:29:35.748ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
532025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
542025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
552025-01-02T23:29:35.748ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-02T23:29:35.748ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
572025-01-02T23:29:35.748ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592025-01-02T23:29:35.748ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
602025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612025-01-02T23:29:35.748ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-02T23:29:35.748ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
632025-01-02T23:29:35.748ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
642025-01-02T23:29:35.748ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672025-01-02T23:29:35.748ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-02T23:29:35.748ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
702025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
712025-01-02T23:29:35.748ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
722025-01-02T23:29:35.748ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
732025-01-02T23:29:35.748ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-02T23:29:35.748ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-02T23:29:35.748ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-02T23:29:35.748ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
782025-01-02T23:29:35.748ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-02T23:29:35.748ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-02T23:29:35.748ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
812025-01-02T23:29:35.748ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
822025-01-02T23:29:35.748ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
832025-01-02T23:29:35.749ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
842025-01-02T23:29:35.749ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
852025-01-02T23:29:35.749ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-02T23:29:35.749ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
872025-01-02T23:29:35.749ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-02T23:29:35.749ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-02T23:29:35.749ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-02T23:29:35.749ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-02T23:29:35.749ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-02T23:29:35.749ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:603
932025-01-02T23:29:35.749ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-02T23:29:35.749ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-01-02T23:29:35.749ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-02T23:29:35.749ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-02T23:29:35.749ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-02T23:29:35.749ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-02T23:29:35.749ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1002025-01-02T23:29:35.749ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-01-02T23:29:35.749ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-01-02T23:29:35.749ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-01-02T23:29:35.749ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-02T23:29:35.749ZINFOSledAgent (bootstore): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1052025-01-02T23:29:35.749ZINFOSledAgent (bootstore): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1062025-01-02T23:29:35.749ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-buskin-i86pc
1072025-01-02T23:29:35.749ZINFOSledAgent (bootstore): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1082025-01-02T23:29:35.749ZINFOSledAgent (bootstore): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-buskin-i86pc
1092025-01-02T23:29:35.749ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-buskin-i86pc
1102025-01-02T23:29:35.749ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-02T23:29:35.749ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-02T23:29:35.760ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:736
1132025-01-02T23:29:35.760ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1296, tv_nsec: 977053078 } time_to_next_cleanup = 599.999926588s
1142025-01-02T23:29:35.760ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
1152025-01-02T23:29:35.760ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1162025-01-02T23:29:35.760ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-02T23:29:35.763ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-02T23:29:35.763ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80
1192025-01-02T23:29:35.765ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:9fb2::1]:12346
1202025-01-02T23:29:35.765ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.1.164, last: 10.151.1.173, }, ), ], external_dns_ips: [ 10.151.1.164, 10.151.1.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1203
1212025-01-02T23:29:35.765ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-02T23:29:35.765ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1232025-01-02T23:29:35.765ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1242025-01-02T23:29:35.765ZINFOSledAgent (RSS): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-02T23:29:35.765ZINFOSledAgent (RSS): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-02T23:29:35.765ZINFOSledAgent (RSS): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-02T23:29:35.765ZINFOSledAgent (RSS): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-02T23:29:35.765ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1252
1292025-01-02T23:29:35.765ZINFOSledAgent (RSS): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-02T23:29:35.766ZINFOSledAgent (RSS): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-02T23:29:35.766ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1284
1322025-01-02T23:29:35.766ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-02T23:29:35.766ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:9fb2::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-02T23:29:35.766ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-02T23:29:35.766ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
1362025-01-02T23:29:35.766ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1372025-01-02T23:29:35.766ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
1382025-01-02T23:29:35.766ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
1392025-01-02T23:29:35.766ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8a1161d7-6d62-4983-bc09-f43d060ae472 (sled), rack_id: 14faf6b0-5f4e-4732-8d82-c8856196086a, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
1402025-01-02T23:29:35.767ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4244
1412025-01-02T23:29:35.767ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4644
1422025-01-02T23:29:35.771ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-02T23:29:35.777ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-02T23:29:35.777ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:9fb2::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-02T23:29:35.781ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-02T23:29:35.781ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-02T23:29:35.781ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:35839
1482025-01-02T23:29:35.781ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 8a1161d7-6d62-4983-bc09-f43d060ae472 (sled), rack_id: 14faf6b0-5f4e-4732-8d82-c8856196086a, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-02T23:29:35.781ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-02T23:29:35.782ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-02T23:29:35.782ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-02T23:29:35.782ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:603
1532025-01-02T23:29:35.782ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:809
1542025-01-02T23:29:35.782ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-02T23:29:35.782ZINFOSledAgent (StorageManager): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-02T23:29:35.782ZINFOSledAgent (StorageManager): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-02T23:29:35.782ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:798
1582025-01-02T23:29:35.782ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:826
1592025-01-02T23:29:35.782ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:592
1602025-01-02T23:29:35.782ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-02T23:29:35.782ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:697 result = DisksManagementResult { status: [] }
1622025-01-02T23:29:35.797ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1632025-01-02T23:29:35.818ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-02T23:29:35.836ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-02T23:29:35.863ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:415 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
1662025-01-02T23:29:35.863ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
1672025-01-02T23:29:35.863ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:427 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
1682025-01-02T23:29:35.863ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-02T23:29:35.866ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 84.808935ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "63e92759-8327-4ae3-93e7-f90072ef99a6", "content-length": "124", "date": "Thu, 02 Jan 2025 23:29:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "63e92759-8327-4ae3-93e7-f90072ef99a6" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-02T23:29:35.876ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-02T23:29:35.905ZINFOSledAgent: successfully created encrypted zvol: name="oxi_dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-02T23:29:35.905ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-02T23:29:35.910ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:442 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
1742025-01-02T23:29:35.910ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:128
1752025-01-02T23:29:35.910ZINFOSledAgent (BackingFs): Ensuring dataset oxi_dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/backing/fmd file = sled-agent/src/backing_fs.rs:138
1762025-01-02T23:29:35.953ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-02T23:29:35.953ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 161.173071ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f9768641-fff5-43a6-9124-e082b7f72be5", "content-length": "124", "date": "Thu, 02 Jan 2025 23:29:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f9768641-fff5-43a6-9124-e082b7f72be5" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-02T23:29:36.010ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:173
1792025-01-02T23:29:36.115ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-02T23:29:36.116ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 202.728126ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f766a01b-a068-40cb-b610-3b07a3761710", "content-length": "124", "date": "Thu, 02 Jan 2025 23:29:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f766a01b-a068-40cb-b610-3b07a3761710" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-02T23:29:36.230ZINFOSledAgent (BackingFs): Mounting oxi_dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:181
1822025-01-02T23:29:36.244ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:189
1832025-01-02T23:29:36.244ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:189
1842025-01-02T23:29:36.244ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:189
1852025-01-02T23:29:36.244ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:195
1862025-01-02T23:29:36.319ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-02T23:29:36.324ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 256.053358ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "373dfa8c-4589-4183-979d-7bfd45baf0b4", "content-length": "124", "date": "Thu, 02 Jan 2025 23:29:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "373dfa8c-4589-4183-979d-7bfd45baf0b4" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-02T23:29:36.580ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-02T23:29:36.581ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 149.620949ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "56af9c57-d632-40ae-b8d7-26a2c72004a8", "content-length": "124", "date": "Thu, 02 Jan 2025 23:29:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "56af9c57-d632-40ae-b8d7-26a2c72004a8" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-02T23:29:36.731ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-02T23:29:36.732ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 186.286482ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7ca7843a-b9d6-4eb2-ad91-423942445a6e", "content-length": "124", "date": "Thu, 02 Jan 2025 23:29:35 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7ca7843a-b9d6-4eb2-ad91-423942445a6e" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-02T23:29:36.920ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-02T23:29:36.920ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 415.787535ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "ae957353-7bf1-4dce-a49e-284ddb0dbb1e", "content-length": "124", "date": "Thu, 02 Jan 2025 23:29:36 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "ae957353-7bf1-4dce-a49e-284ddb0dbb1e" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-02T23:29:36.996ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
1952025-01-02T23:29:37.002ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:44001 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
1962025-01-02T23:29:37.002ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
1972025-01-02T23:29:37.002ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:44001 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
1982025-01-02T23:29:37.003ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 141.736106ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
1992025-01-02T23:29:37.004ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2002025-01-02T23:29:37.004ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2012025-01-02T23:29:37.004ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:920 underlay_address = fd00:1122:3344:101::1
2022025-01-02T23:29:37.004ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-02T23:29:37.149ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 548.804193ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2042025-01-02T23:29:37.337ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2052025-01-02T23:29:37.700ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.449574717s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2062025-01-02T23:29:39.151ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.125871613s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2072025-01-02T23:29:39.621ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2668
2082025-01-02T23:29:39.621ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2913
2092025-01-02T23:29:39.621ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2538
2102025-01-02T23:29:39.621ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2585
2112025-01-02T23:29:39.621ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:2994
2122025-01-02T23:29:39.621ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3039
2132025-01-02T23:29:39.622ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2838
2142025-01-02T23:29:39.624ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2579
2152025-01-02T23:29:39.624ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='52fdc09d-5676-4437-9488-acd06252ee6d'/> <propval type="astring" name="rack_id" value='14faf6b0-5f4e-4732-8d82-c8856196086a'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:9fb2::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fee8:25d7'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:9fb2::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"buskin","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='14faf6b0-5f4e-4732-8d82-c8856196086a'/> <propval type="astring" name="sled_id" value='8a1161d7-6d62-4983-bc09-f43d060ae472'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='buskin'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='buskin'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='8a1161d7-6d62-4983-bc09-f43d060ae472'/> <propval type="astring" name="rack_uuid" value='14faf6b0-5f4e-4732-8d82-c8856196086a'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='8a1161d7-6d62-4983-bc09-f43d060ae472'/> <propval type="astring" name="rack_uuid" value='14faf6b0-5f4e-4732-8d82-c8856196086a'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-02T23:29:39.624ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-02T23:29:39.991ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 41.499907ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182025-01-02T23:29:40.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 55.566528ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192025-01-02T23:29:40.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 148.977786ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-02T23:29:40.574ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 507.075312ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212025-01-02T23:29:41.151ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 632.880889ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2222025-01-02T23:29:41.278ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.431663353s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2232025-01-02T23:29:41.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 558.432686ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-02T23:29:42.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 589.432578ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252025-01-02T23:29:43.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 637.926016ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262025-01-02T23:29:44.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.19942838s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2272025-01-02T23:29:45.532ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/nexus.rs:527 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2282025-01-02T23:29:45.562ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2292025-01-02T23:29:45.562ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2302025-01-02T23:29:45.563ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2312025-01-02T23:29:45.563ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2322025-01-02T23:29:45.563ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2332025-01-02T23:29:45.563ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-02T23:29:45.563ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2352025-01-02T23:29:45.563ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2362025-01-02T23:29:45.563ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2372025-01-02T23:29:45.563ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3947
2382025-01-02T23:29:45.564ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:9fb2::1]:35839
2392025-01-02T23:29:45.785ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:9fb2::1]:12346
2402025-01-02T23:29:45.785ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:9fb2::1]:12346
2412025-01-02T23:29:45.793ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4268 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422025-01-02T23:29:45.793ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4284
2432025-01-02T23:29:45.793ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2442025-01-02T23:29:46.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40316
2452025-01-02T23:29:46.050ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2462025-01-02T23:29:46.050ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
2472025-01-02T23:29:46.050ZINFOSledAgent (ServiceManager): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-01-02T23:29:46.050ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:188
2492025-01-02T23:29:46.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 316 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40316 req_id = 95be14cd-a54d-4a56-a2ba-cb34d51668f4 response_code = 200 uri = /inventory
2502025-01-02T23:29:46.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53884
2512025-01-02T23:29:46.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53884 req_id = 6e227380-4be1-40ab-b9ec-dc3eff601224 response_code = 200 uri = /sled-role
2522025-01-02T23:29:46.113ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c1cae56b-89fc-4c6b-950d-5903162bd520 (physical_disk), pool_id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e4954386-b89d-47cb-8dfb-5e42c28401fb (physical_disk), pool_id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 3069ed44-74ad-46c7-b61b-c78ea5b93bb5 (physical_disk), pool_id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: df040178-4144-4706-bcbe-40b72a8314f7 (physical_disk), pool_id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 1da0ca53-cb2a-4156-a3ce-a407b3e3ddeb (physical_disk), pool_id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 71d9474c-0aac-4b12-9380-cdff06f7d3dc (physical_disk), pool_id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 96860802-6fc0-4237-a272-0f5e175e91e4 (physical_disk), pool_id: bd42dc62-762a-4947-84e6-57025e292015 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 619d46d5-166e-4d23-97f0-7a69f7a31299 (physical_disk), pool_id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0ccce565-aca2-42eb-9567-2bfaad6a4ff6 (physical_disk), pool_id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2532025-01-02T23:29:46.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40710
2542025-01-02T23:29:46.113ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:896 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2552025-01-02T23:29:46.113ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: c1cae56b-89fc-4c6b-950d-5903162bd520 (physical_disk), pool_id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e4954386-b89d-47cb-8dfb-5e42c28401fb (physical_disk), pool_id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 3069ed44-74ad-46c7-b61b-c78ea5b93bb5 (physical_disk), pool_id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: df040178-4144-4706-bcbe-40b72a8314f7 (physical_disk), pool_id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 1da0ca53-cb2a-4156-a3ce-a407b3e3ddeb (physical_disk), pool_id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 71d9474c-0aac-4b12-9380-cdff06f7d3dc (physical_disk), pool_id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 96860802-6fc0-4237-a272-0f5e175e91e4 (physical_disk), pool_id: bd42dc62-762a-4947-84e6-57025e292015 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 619d46d5-166e-4d23-97f0-7a69f7a31299 (physical_disk), pool_id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 0ccce565-aca2-42eb-9567-2bfaad6a4ff6 (physical_disk), pool_id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:603
2562025-01-02T23:29:46.113ZINFOSledAgent (StorageManager): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2572025-01-02T23:29:46.113ZINFOSledAgent (StorageManager): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2582025-01-02T23:29:46.113ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1171 request = omicron_physical_disks_ensure
2592025-01-02T23:29:46.113ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2602025-01-02T23:29:46.113ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2612025-01-02T23:29:46.113ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2622025-01-02T23:29:46.113ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2632025-01-02T23:29:46.277ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2642025-01-02T23:29:46.277ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool)
2652025-01-02T23:29:46.565ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2662025-01-02T23:29:46.780ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 11.334629766s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2672025-01-02T23:29:47.006ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2682025-01-02T23:29:47.007ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2692025-01-02T23:29:47.490ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2702025-01-02T23:29:47.504ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }
2712025-01-02T23:29:47.512ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:240
2722025-01-02T23:29:47.512ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:242
2732025-01-02T23:29:47.512ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:246
2742025-01-02T23:29:47.512ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:248
2752025-01-02T23:29:47.512ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2762025-01-02T23:29:47.512ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772025-01-02T23:29:47.512ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2782025-01-02T23:29:47.555ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2792025-01-02T23:29:47.562ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone file = sled-storage/src/dataset.rs:303
2802025-01-02T23:29:47.567ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
2812025-01-02T23:29:47.770ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e file = sled-storage/src/dataset.rs:389
2822025-01-02T23:29:47.778ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2832025-01-02T23:29:47.778ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2842025-01-02T23:29:47.778ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2852025-01-02T23:29:47.778ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2862025-01-02T23:29:47.778ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2872025-01-02T23:29:47.788ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2882025-01-02T23:29:47.788ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool)
2892025-01-02T23:29:47.899ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }
2902025-01-02T23:29:47.906ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:240
2912025-01-02T23:29:47.907ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:242
2922025-01-02T23:29:47.907ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:246
2932025-01-02T23:29:47.907ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:248
2942025-01-02T23:29:47.907ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952025-01-02T23:29:47.907ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2962025-01-02T23:29:47.907ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
2972025-01-02T23:29:47.949ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2982025-01-02T23:29:47.957ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone file = sled-storage/src/dataset.rs:303
2992025-01-02T23:29:48.166ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9c569eb8-99da-4c39-9e12-41759dba24d6 file = sled-storage/src/dataset.rs:389
3002025-01-02T23:29:48.174ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3012025-01-02T23:29:48.174ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3022025-01-02T23:29:48.174ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3032025-01-02T23:29:48.174ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3042025-01-02T23:29:48.174ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3052025-01-02T23:29:48.184ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3062025-01-02T23:29:48.184ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool)
3072025-01-02T23:29:48.300ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }
3082025-01-02T23:29:48.308ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:240
3092025-01-02T23:29:48.308ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:242
3102025-01-02T23:29:48.308ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:246
3112025-01-02T23:29:48.308ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:248
3122025-01-02T23:29:48.308ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3132025-01-02T23:29:48.308ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3142025-01-02T23:29:48.308ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3152025-01-02T23:29:48.349ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3162025-01-02T23:29:48.357ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crypt/zone file = sled-storage/src/dataset.rs:303
3172025-01-02T23:29:48.557ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_761fec61-ade0-4579-af52-842b38e6e3a3 file = sled-storage/src/dataset.rs:389
3182025-01-02T23:29:48.565ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3192025-01-02T23:29:48.565ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3202025-01-02T23:29:48.565ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3212025-01-02T23:29:48.565ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3222025-01-02T23:29:48.565ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3232025-01-02T23:29:48.574ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3242025-01-02T23:29:48.574ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool)
3252025-01-02T23:29:48.684ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }
3262025-01-02T23:29:48.692ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:240
3272025-01-02T23:29:48.692ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:242
3282025-01-02T23:29:48.692ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:246
3292025-01-02T23:29:48.692ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:248
3302025-01-02T23:29:48.692ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3312025-01-02T23:29:48.692ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322025-01-02T23:29:48.692ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3332025-01-02T23:29:48.696ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
3342025-01-02T23:29:48.737ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3352025-01-02T23:29:48.745ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/zone file = sled-storage/src/dataset.rs:303
3362025-01-02T23:29:48.948ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 file = sled-storage/src/dataset.rs:389
3372025-01-02T23:29:48.956ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3382025-01-02T23:29:48.956ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3392025-01-02T23:29:48.956ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3402025-01-02T23:29:48.956ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3412025-01-02T23:29:48.956ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3422025-01-02T23:29:48.965ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3432025-01-02T23:29:48.965ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool)
3442025-01-02T23:29:49.069ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }
3452025-01-02T23:29:49.076ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:240
3462025-01-02T23:29:49.076ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:242
3472025-01-02T23:29:49.076ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:246
3482025-01-02T23:29:49.076ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:248
3492025-01-02T23:29:49.076ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502025-01-02T23:29:49.076ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3512025-01-02T23:29:49.076ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3522025-01-02T23:29:49.119ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3532025-01-02T23:29:49.127ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/zone file = sled-storage/src/dataset.rs:303
3542025-01-02T23:29:49.337ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5 file = sled-storage/src/dataset.rs:389
3552025-01-02T23:29:49.345ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3562025-01-02T23:29:49.345ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3572025-01-02T23:29:49.345ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3582025-01-02T23:29:49.345ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3592025-01-02T23:29:49.345ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3602025-01-02T23:29:49.355ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3612025-01-02T23:29:49.355ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 3422f079-8bbb-4453-89ec-a156fe56575a (zpool)
3622025-01-02T23:29:49.489ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }
3632025-01-02T23:29:49.498ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:240
3642025-01-02T23:29:49.498ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:242
3652025-01-02T23:29:49.498ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:246
3662025-01-02T23:29:49.498ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:248
3672025-01-02T23:29:49.498ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3682025-01-02T23:29:49.498ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3692025-01-02T23:29:49.498ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3702025-01-02T23:29:49.544ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3712025-01-02T23:29:49.552ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_3422f079-8bbb-4453-89ec-a156fe56575a/crypt/zone file = sled-storage/src/dataset.rs:303
3722025-01-02T23:29:49.699ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
3732025-01-02T23:29:49.754ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_3422f079-8bbb-4453-89ec-a156fe56575a file = sled-storage/src/dataset.rs:389
3742025-01-02T23:29:49.763ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3752025-01-02T23:29:49.763ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3762025-01-02T23:29:49.763ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3772025-01-02T23:29:49.763ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3782025-01-02T23:29:49.763ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3792025-01-02T23:29:49.772ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3802025-01-02T23:29:49.773ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bd42dc62-762a-4947-84e6-57025e292015 (zpool)
3812025-01-02T23:29:49.886ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }
3822025-01-02T23:29:49.894ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:240
3832025-01-02T23:29:49.894ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:242
3842025-01-02T23:29:49.894ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:246
3852025-01-02T23:29:49.894ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:248
3862025-01-02T23:29:49.894ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872025-01-02T23:29:49.895ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3882025-01-02T23:29:49.895ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
3892025-01-02T23:29:49.935ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3902025-01-02T23:29:49.943ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bd42dc62-762a-4947-84e6-57025e292015/crypt/zone file = sled-storage/src/dataset.rs:303
3912025-01-02T23:29:50.148ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bd42dc62-762a-4947-84e6-57025e292015 file = sled-storage/src/dataset.rs:389
3922025-01-02T23:29:50.156ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3932025-01-02T23:29:50.156ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3942025-01-02T23:29:50.156ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3952025-01-02T23:29:50.156ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3962025-01-02T23:29:50.156ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3972025-01-02T23:29:50.165ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3982025-01-02T23:29:50.165ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool)
3992025-01-02T23:29:50.273ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }
4002025-01-02T23:29:50.281ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:240
4012025-01-02T23:29:50.281ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:242
4022025-01-02T23:29:50.281ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:246
4032025-01-02T23:29:50.281ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:248
4042025-01-02T23:29:50.281ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052025-01-02T23:29:50.281ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4062025-01-02T23:29:50.281ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4072025-01-02T23:29:50.323ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4082025-01-02T23:29:50.330ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone file = sled-storage/src/dataset.rs:303
4092025-01-02T23:29:50.526ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d file = sled-storage/src/dataset.rs:389
4102025-01-02T23:29:50.533ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4112025-01-02T23:29:50.533ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4122025-01-02T23:29:50.533ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4132025-01-02T23:29:50.533ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4142025-01-02T23:29:50.533ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4152025-01-02T23:29:50.543ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4162025-01-02T23:29:50.543ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool)
4172025-01-02T23:29:50.655ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }
4182025-01-02T23:29:50.663ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:240
4192025-01-02T23:29:50.663ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:242
4202025-01-02T23:29:50.663ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:246
4212025-01-02T23:29:50.663ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:248
4222025-01-02T23:29:50.663ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232025-01-02T23:29:50.663ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242025-01-02T23:29:50.663ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:260
4252025-01-02T23:29:50.698ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4262025-01-02T23:29:50.702ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4272025-01-02T23:29:50.706ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crypt/zone file = sled-storage/src/dataset.rs:303
4282025-01-02T23:29:50.905ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 file = sled-storage/src/dataset.rs:389
4292025-01-02T23:29:50.913ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4302025-01-02T23:29:50.913ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4312025-01-02T23:29:50.913ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322025-01-02T23:29:50.913ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dbbd10b4-0e65-490e-bf68-d8076e9cc5f6 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e447c503-e3d7-466e-a61b-e086843a2be9 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4332025-01-02T23:29:50.913ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4342025-01-02T23:29:50.913ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4352025-01-02T23:29:50.913ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4362025-01-02T23:29:50.913ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:900 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4372025-01-02T23:29:50.913ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
4382025-01-02T23:29:50.913ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:926 generation = Generation(2) sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4392025-01-02T23:29:50.913ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:931 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4402025-01-02T23:29:50.913ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:936 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4412025-01-02T23:29:50.913ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4422025-01-02T23:29:50.913ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:942 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4432025-01-02T23:29:50.913ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4442025-01-02T23:29:50.913ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:947 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4452025-01-02T23:29:50.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4800415 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:40710 req_id = 81137c3c-be44-4bce-a264-e68b4f5680d8 response_code = 200 uri = /omicron-physical-disks
4462025-01-02T23:29:50.945ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {00891307-dc9f-4bb1-84d1-c15c374af46a (dataset): DatasetConfig { id: 00891307-dc9f-4bb1-84d1-c15c374af46a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04b91e48-4d7c-44ba-b6fd-c81cb5c564b8 (dataset): DatasetConfig { id: 04b91e48-4d7c-44ba-b6fd-c81cb5c564b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 060ea721-63fb-4931-9567-801aa3a8dbe8 (dataset): DatasetConfig { id: 060ea721-63fb-4931-9567-801aa3a8dbe8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0615eec2-902c-4e4e-b35f-655b749207c7 (dataset): DatasetConfig { id: 0615eec2-902c-4e4e-b35f-655b749207c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08ce9e65-821e-4b13-9a6b-9f6922a260f7 (dataset): DatasetConfig { id: 08ce9e65-821e-4b13-9a6b-9f6922a260f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e67f937-ef4b-4ee6-ae70-b4016e326889 (dataset): DatasetConfig { id: 0e67f937-ef4b-4ee6-ae70-b4016e326889 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1407da70-d624-4876-9b0f-0c59e20cfbd9 (dataset): DatasetConfig { id: 1407da70-d624-4876-9b0f-0c59e20cfbd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17d3fa69-61df-4127-8960-28bb9a44d7dd (dataset): DatasetConfig { id: 17d3fa69-61df-4127-8960-28bb9a44d7dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a762252-d124-4d7d-b860-10737ad4493d (dataset): DatasetConfig { id: 1a762252-d124-4d7d-b860-10737ad4493d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20c9f24a-20c1-4aff-918a-f9bd0bd49646 (dataset): DatasetConfig { id: 20c9f24a-20c1-4aff-918a-f9bd0bd49646 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 23939966-82c4-4fb5-8c16-f86de698c2d1 (dataset): DatasetConfig { id: 23939966-82c4-4fb5-8c16-f86de698c2d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 245719e2-cc89-4b2c-9305-b05b74005169 (dataset): DatasetConfig { id: 245719e2-cc89-4b2c-9305-b05b74005169 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c0a2802-bdf9-404e-9bce-efa261d9fd0f (dataset): DatasetConfig { id: 2c0a2802-bdf9-404e-9bce-efa261d9fd0f (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c87493e-91d5-476f-bc0b-b7f84e1b3829 (dataset): DatasetConfig { id: 3c87493e-91d5-476f-bc0b-b7f84e1b3829 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 448bf45b-2ee5-4ba4-ade6-c804501e51e7 (dataset): DatasetConfig { id: 448bf45b-2ee5-4ba4-ade6-c804501e51e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 455718b1-1713-47a8-bb0f-c478daeb7eb6 (dataset): DatasetConfig { id: 455718b1-1713-47a8-bb0f-c478daeb7eb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4bc1b331-9781-4e50-971d-6270ad43e84a (dataset): DatasetConfig { id: 4bc1b331-9781-4e50-971d-6270ad43e84a (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c0552e7-d3fa-4304-8323-afd3d90d08f5 (dataset): DatasetConfig { id: 4c0552e7-d3fa-4304-8323-afd3d90d08f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53f5b60e-95df-4f8d-980f-1f70a7282045 (dataset): DatasetConfig { id: 53f5b60e-95df-4f8d-980f-1f70a7282045 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5c5cad53-9e17-44cf-92fe-9a2f6b0f1de2 (dataset): DatasetConfig { id: 5c5cad53-9e17-44cf-92fe-9a2f6b0f1de2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e0a99f8-3712-479c-8118-cb627800d6c4 (dataset): DatasetConfig { id: 5e0a99f8-3712-479c-8118-cb627800d6c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 607f39ed-5ace-4cf4-8d2b-1a8dfce27a0b (dataset): DatasetConfig { id: 607f39ed-5ace-4cf4-8d2b-1a8dfce27a0b (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6207e00c-337d-40d3-b42a-ca1bfbf108d6 (dataset): DatasetConfig { id: 6207e00c-337d-40d3-b42a-ca1bfbf108d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 671b24e2-54b9-4e22-a4fe-1104a139db23 (dataset): DatasetConfig { id: 671b24e2-54b9-4e22-a4fe-1104a139db23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f5c59b7-f7ab-49cd-9cd0-827e617d9b93 (dataset): DatasetConfig { id: 6f5c59b7-f7ab-49cd-9cd0-827e617d9b93 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f6038b9-7a3a-4edc-9081-7788bf2c4c63 (dataset): DatasetConfig { id: 6f6038b9-7a3a-4edc-9081-7788bf2c4c63 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7218e583-79a4-47fd-a04d-31967f029c20 (dataset): DatasetConfig { id: 7218e583-79a4-47fd-a04d-31967f029c20 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 744918ee-6c26-45cd-96b9-1e6e3bd04259 (dataset): DatasetConfig { id: 744918ee-6c26-45cd-96b9-1e6e3bd04259 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74968dcc-8217-4856-abf5-47d43555b568 (dataset): DatasetConfig { id: 74968dcc-8217-4856-abf5-47d43555b568 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75a95b5c-6191-470e-870f-0df3e7030cf4 (dataset): DatasetConfig { id: 75a95b5c-6191-470e-870f-0df3e7030cf4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78bbc7d3-527d-4ef5-be64-bd19b02f8695 (dataset): DatasetConfig { id: 78bbc7d3-527d-4ef5-be64-bd19b02f8695 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a0794eb-fa20-46bb-926f-6644dda23f1a (dataset): DatasetConfig { id: 7a0794eb-fa20-46bb-926f-6644dda23f1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b4f4965-8684-47e5-b426-9868ab3c2e8a (dataset): DatasetConfig { id: 7b4f4965-8684-47e5-b426-9868ab3c2e8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b92a766-6a5f-4d49-a20a-fd8b61d2c563 (dataset): DatasetConfig { id: 7b92a766-6a5f-4d49-a20a-fd8b61d2c563 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ca1eba2-69c9-4858-9f38-0487e397745a (dataset): DatasetConfig { id: 7ca1eba2-69c9-4858-9f38-0487e397745a (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82361b22-18ba-4027-8b5b-568f21aec479 (dataset): DatasetConfig { id: 82361b22-18ba-4027-8b5b-568f21aec479 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82c4785d-969b-441c-b5ed-90562e4e0c89 (dataset): DatasetConfig { id: 82c4785d-969b-441c-b5ed-90562e4e0c89 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d17b15f-6f54-4c78-b35e-c0ad8b67edd5 (dataset): DatasetConfig { id: 8d17b15f-6f54-4c78-b35e-c0ad8b67edd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dd48813-d86e-48c4-9e4a-fbb7a5c0a13a (dataset): DatasetConfig { id: 8dd48813-d86e-48c4-9e4a-fbb7a5c0a13a (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e000e05-ceb0-4258-9b8e-d726d7dfc8c6 (dataset): DatasetConfig { id: 8e000e05-ceb0-4258-9b8e-d726d7dfc8c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e1e2fdf-704d-4580-9864-1f335f1754a8 (dataset): DatasetConfig { id: 8e1e2fdf-704d-4580-9864-1f335f1754a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e64abda-57e8-4470-9d61-91fbd320e512 (dataset): DatasetConfig { id: 8e64abda-57e8-4470-9d61-91fbd320e512 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92effae3-ca0a-4e4e-93f7-80fc3a09dfa7 (dataset): DatasetConfig { id: 92effae3-ca0a-4e4e-93f7-80fc3a09dfa7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 974c60c2-7130-42c0-babd-e35ea9b17cb0 (dataset): DatasetConfig { id: 974c60c2-7130-42c0-babd-e35ea9b17cb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 990d800d-3467-4c8e-96a5-dd91f5b33f39 (dataset): DatasetConfig { id: 990d800d-3467-4c8e-96a5-dd91f5b33f39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a421788-d2b6-42ba-8714-220b01694137 (dataset): DatasetConfig { id: 9a421788-d2b6-42ba-8714-220b01694137 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9f9ff24c-3926-4f5a-b031-97d8bad27fd5 (dataset): DatasetConfig { id: 9f9ff24c-3926-4f5a-b031-97d8bad27fd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a07a0007-80e3-4104-b61e-eddd5df05497 (dataset): DatasetConfig { id: a07a0007-80e3-4104-b61e-eddd5df05497 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1549739-496d-4a50-95c9-51bb0faa1c8a (dataset): DatasetConfig { id: a1549739-496d-4a50-95c9-51bb0faa1c8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afacbd68-f66a-44c9-bf69-389cf1b86144 (dataset): DatasetConfig { id: afacbd68-f66a-44c9-bf69-389cf1b86144 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b50e3488-797e-4619-86d3-c3013cefa630 (dataset): DatasetConfig { id: b50e3488-797e-4619-86d3-c3013cefa630 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9238ef1-3277-430a-bfe0-9eef32afba44 (dataset): DatasetConfig { id: b9238ef1-3277-430a-bfe0-9eef32afba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c40401b5-c017-4430-bc55-a3ee56cc45d6 (dataset): DatasetConfig { id: c40401b5-c017-4430-bc55-a3ee56cc45d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4e27f5b-38bd-4e08-b76e-274c19509867 (dataset): DatasetConfig { id: c4e27f5b-38bd-4e08-b76e-274c19509867 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5338e4e-75e2-45ab-8d10-5f89c14f8e29 (dataset): DatasetConfig { id: c5338e4e-75e2-45ab-8d10-5f89c14f8e29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7b02cf8-56ad-44f4-8b96-34c1b02df5ce (dataset): DatasetConfig { id: c7b02cf8-56ad-44f4-8b96-34c1b02df5ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d637db0e-f2ff-4f63-975f-a1dcfd74de55 (dataset): DatasetConfig { id: d637db0e-f2ff-4f63-975f-a1dcfd74de55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d75caa42-d368-4733-bd54-5fa58e812790 (dataset): DatasetConfig { id: d75caa42-d368-4733-bd54-5fa58e812790 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e57971c2-f3d0-4a0a-80f7-6e288b754243 (dataset): DatasetConfig { id: e57971c2-f3d0-4a0a-80f7-6e288b754243 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e736e95d-68d1-47ca-aa97-0281475f8803 (dataset): DatasetConfig { id: e736e95d-68d1-47ca-aa97-0281475f8803 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec6acf34-5175-4ada-8954-5ab64f9b9639 (dataset): DatasetConfig { id: ec6acf34-5175-4ada-8954-5ab64f9b9639 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f51332e7-baab-401b-b402-5635b998b0c8 (dataset): DatasetConfig { id: f51332e7-baab-401b-b402-5635b998b0c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5e2148d-0378-44d9-9805-be92dc2e32d1 (dataset): DatasetConfig { id: f5e2148d-0378-44d9-9805-be92dc2e32d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb8396db-3d95-4f00-84d3-cfb81e2c6263 (dataset): DatasetConfig { id: fb8396db-3d95-4f00-84d3-cfb81e2c6263 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe44e1c9-ecfe-4be4-ab85-df29d1e410e4 (dataset): DatasetConfig { id: fe44e1c9-ecfe-4be4-ab85-df29d1e410e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe75127e-1d72-4277-97bf-938ba396e499 (dataset): DatasetConfig { id: fe75127e-1d72-4277-97bf-938ba396e499 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4472025-01-02T23:29:50.945ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37014
4482025-01-02T23:29:50.946ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:862 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4492025-01-02T23:29:50.946ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {00891307-dc9f-4bb1-84d1-c15c374af46a (dataset): DatasetConfig { id: 00891307-dc9f-4bb1-84d1-c15c374af46a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 04b91e48-4d7c-44ba-b6fd-c81cb5c564b8 (dataset): DatasetConfig { id: 04b91e48-4d7c-44ba-b6fd-c81cb5c564b8 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 060ea721-63fb-4931-9567-801aa3a8dbe8 (dataset): DatasetConfig { id: 060ea721-63fb-4931-9567-801aa3a8dbe8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0615eec2-902c-4e4e-b35f-655b749207c7 (dataset): DatasetConfig { id: 0615eec2-902c-4e4e-b35f-655b749207c7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08ce9e65-821e-4b13-9a6b-9f6922a260f7 (dataset): DatasetConfig { id: 08ce9e65-821e-4b13-9a6b-9f6922a260f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0e67f937-ef4b-4ee6-ae70-b4016e326889 (dataset): DatasetConfig { id: 0e67f937-ef4b-4ee6-ae70-b4016e326889 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1407da70-d624-4876-9b0f-0c59e20cfbd9 (dataset): DatasetConfig { id: 1407da70-d624-4876-9b0f-0c59e20cfbd9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 17d3fa69-61df-4127-8960-28bb9a44d7dd (dataset): DatasetConfig { id: 17d3fa69-61df-4127-8960-28bb9a44d7dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a762252-d124-4d7d-b860-10737ad4493d (dataset): DatasetConfig { id: 1a762252-d124-4d7d-b860-10737ad4493d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 20c9f24a-20c1-4aff-918a-f9bd0bd49646 (dataset): DatasetConfig { id: 20c9f24a-20c1-4aff-918a-f9bd0bd49646 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 23939966-82c4-4fb5-8c16-f86de698c2d1 (dataset): DatasetConfig { id: 23939966-82c4-4fb5-8c16-f86de698c2d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 245719e2-cc89-4b2c-9305-b05b74005169 (dataset): DatasetConfig { id: 245719e2-cc89-4b2c-9305-b05b74005169 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c0a2802-bdf9-404e-9bce-efa261d9fd0f (dataset): DatasetConfig { id: 2c0a2802-bdf9-404e-9bce-efa261d9fd0f (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c87493e-91d5-476f-bc0b-b7f84e1b3829 (dataset): DatasetConfig { id: 3c87493e-91d5-476f-bc0b-b7f84e1b3829 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 448bf45b-2ee5-4ba4-ade6-c804501e51e7 (dataset): DatasetConfig { id: 448bf45b-2ee5-4ba4-ade6-c804501e51e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 455718b1-1713-47a8-bb0f-c478daeb7eb6 (dataset): DatasetConfig { id: 455718b1-1713-47a8-bb0f-c478daeb7eb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4bc1b331-9781-4e50-971d-6270ad43e84a (dataset): DatasetConfig { id: 4bc1b331-9781-4e50-971d-6270ad43e84a (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c0552e7-d3fa-4304-8323-afd3d90d08f5 (dataset): DatasetConfig { id: 4c0552e7-d3fa-4304-8323-afd3d90d08f5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53f5b60e-95df-4f8d-980f-1f70a7282045 (dataset): DatasetConfig { id: 53f5b60e-95df-4f8d-980f-1f70a7282045 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5c5cad53-9e17-44cf-92fe-9a2f6b0f1de2 (dataset): DatasetConfig { id: 5c5cad53-9e17-44cf-92fe-9a2f6b0f1de2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e0a99f8-3712-479c-8118-cb627800d6c4 (dataset): DatasetConfig { id: 5e0a99f8-3712-479c-8118-cb627800d6c4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 607f39ed-5ace-4cf4-8d2b-1a8dfce27a0b (dataset): DatasetConfig { id: 607f39ed-5ace-4cf4-8d2b-1a8dfce27a0b (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6207e00c-337d-40d3-b42a-ca1bfbf108d6 (dataset): DatasetConfig { id: 6207e00c-337d-40d3-b42a-ca1bfbf108d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 671b24e2-54b9-4e22-a4fe-1104a139db23 (dataset): DatasetConfig { id: 671b24e2-54b9-4e22-a4fe-1104a139db23 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f5c59b7-f7ab-49cd-9cd0-827e617d9b93 (dataset): DatasetConfig { id: 6f5c59b7-f7ab-49cd-9cd0-827e617d9b93 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6f6038b9-7a3a-4edc-9081-7788bf2c4c63 (dataset): DatasetConfig { id: 6f6038b9-7a3a-4edc-9081-7788bf2c4c63 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7218e583-79a4-47fd-a04d-31967f029c20 (dataset): DatasetConfig { id: 7218e583-79a4-47fd-a04d-31967f029c20 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 744918ee-6c26-45cd-96b9-1e6e3bd04259 (dataset): DatasetConfig { id: 744918ee-6c26-45cd-96b9-1e6e3bd04259 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 74968dcc-8217-4856-abf5-47d43555b568 (dataset): DatasetConfig { id: 74968dcc-8217-4856-abf5-47d43555b568 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 75a95b5c-6191-470e-870f-0df3e7030cf4 (dataset): DatasetConfig { id: 75a95b5c-6191-470e-870f-0df3e7030cf4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 78bbc7d3-527d-4ef5-be64-bd19b02f8695 (dataset): DatasetConfig { id: 78bbc7d3-527d-4ef5-be64-bd19b02f8695 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7a0794eb-fa20-46bb-926f-6644dda23f1a (dataset): DatasetConfig { id: 7a0794eb-fa20-46bb-926f-6644dda23f1a (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7b4f4965-8684-47e5-b426-9868ab3c2e8a (dataset): DatasetConfig { id: 7b4f4965-8684-47e5-b426-9868ab3c2e8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7b92a766-6a5f-4d49-a20a-fd8b61d2c563 (dataset): DatasetConfig { id: 7b92a766-6a5f-4d49-a20a-fd8b61d2c563 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7ca1eba2-69c9-4858-9f38-0487e397745a (dataset): DatasetConfig { id: 7ca1eba2-69c9-4858-9f38-0487e397745a (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82361b22-18ba-4027-8b5b-568f21aec479 (dataset): DatasetConfig { id: 82361b22-18ba-4027-8b5b-568f21aec479 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82c4785d-969b-441c-b5ed-90562e4e0c89 (dataset): DatasetConfig { id: 82c4785d-969b-441c-b5ed-90562e4e0c89 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8d17b15f-6f54-4c78-b35e-c0ad8b67edd5 (dataset): DatasetConfig { id: 8d17b15f-6f54-4c78-b35e-c0ad8b67edd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8dd48813-d86e-48c4-9e4a-fbb7a5c0a13a (dataset): DatasetConfig { id: 8dd48813-d86e-48c4-9e4a-fbb7a5c0a13a (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e000e05-ceb0-4258-9b8e-d726d7dfc8c6 (dataset): DatasetConfig { id: 8e000e05-ceb0-4258-9b8e-d726d7dfc8c6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e1e2fdf-704d-4580-9864-1f335f1754a8 (dataset): DatasetConfig { id: 8e1e2fdf-704d-4580-9864-1f335f1754a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e64abda-57e8-4470-9d61-91fbd320e512 (dataset): DatasetConfig { id: 8e64abda-57e8-4470-9d61-91fbd320e512 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92effae3-ca0a-4e4e-93f7-80fc3a09dfa7 (dataset): DatasetConfig { id: 92effae3-ca0a-4e4e-93f7-80fc3a09dfa7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 974c60c2-7130-42c0-babd-e35ea9b17cb0 (dataset): DatasetConfig { id: 974c60c2-7130-42c0-babd-e35ea9b17cb0 (dataset), name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 990d800d-3467-4c8e-96a5-dd91f5b33f39 (dataset): DatasetConfig { id: 990d800d-3467-4c8e-96a5-dd91f5b33f39 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9a421788-d2b6-42ba-8714-220b01694137 (dataset): DatasetConfig { id: 9a421788-d2b6-42ba-8714-220b01694137 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 9f9ff24c-3926-4f5a-b031-97d8bad27fd5 (dataset): DatasetConfig { id: 9f9ff24c-3926-4f5a-b031-97d8bad27fd5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a07a0007-80e3-4104-b61e-eddd5df05497 (dataset): DatasetConfig { id: a07a0007-80e3-4104-b61e-eddd5df05497 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a1549739-496d-4a50-95c9-51bb0faa1c8a (dataset): DatasetConfig { id: a1549739-496d-4a50-95c9-51bb0faa1c8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, afacbd68-f66a-44c9-bf69-389cf1b86144 (dataset): DatasetConfig { id: afacbd68-f66a-44c9-bf69-389cf1b86144 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b50e3488-797e-4619-86d3-c3013cefa630 (dataset): DatasetConfig { id: b50e3488-797e-4619-86d3-c3013cefa630 (dataset), name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9238ef1-3277-430a-bfe0-9eef32afba44 (dataset): DatasetConfig { id: b9238ef1-3277-430a-bfe0-9eef32afba44 (dataset), name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c40401b5-c017-4430-bc55-a3ee56cc45d6 (dataset): DatasetConfig { id: c40401b5-c017-4430-bc55-a3ee56cc45d6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c4e27f5b-38bd-4e08-b76e-274c19509867 (dataset): DatasetConfig { id: c4e27f5b-38bd-4e08-b76e-274c19509867 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c5338e4e-75e2-45ab-8d10-5f89c14f8e29 (dataset): DatasetConfig { id: c5338e4e-75e2-45ab-8d10-5f89c14f8e29 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c7b02cf8-56ad-44f4-8b96-34c1b02df5ce (dataset): DatasetConfig { id: c7b02cf8-56ad-44f4-8b96-34c1b02df5ce (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d637db0e-f2ff-4f63-975f-a1dcfd74de55 (dataset): DatasetConfig { id: d637db0e-f2ff-4f63-975f-a1dcfd74de55 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d75caa42-d368-4733-bd54-5fa58e812790 (dataset): DatasetConfig { id: d75caa42-d368-4733-bd54-5fa58e812790 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e57971c2-f3d0-4a0a-80f7-6e288b754243 (dataset): DatasetConfig { id: e57971c2-f3d0-4a0a-80f7-6e288b754243 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e736e95d-68d1-47ca-aa97-0281475f8803 (dataset): DatasetConfig { id: e736e95d-68d1-47ca-aa97-0281475f8803 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ec6acf34-5175-4ada-8954-5ab64f9b9639 (dataset): DatasetConfig { id: ec6acf34-5175-4ada-8954-5ab64f9b9639 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f51332e7-baab-401b-b402-5635b998b0c8 (dataset): DatasetConfig { id: f51332e7-baab-401b-b402-5635b998b0c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f5e2148d-0378-44d9-9805-be92dc2e32d1 (dataset): DatasetConfig { id: f5e2148d-0378-44d9-9805-be92dc2e32d1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb8396db-3d95-4f00-84d3-cfb81e2c6263 (dataset): DatasetConfig { id: fb8396db-3d95-4f00-84d3-cfb81e2c6263 (dataset), name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe44e1c9-ecfe-4be4-ab85-df29d1e410e4 (dataset): DatasetConfig { id: fe44e1c9-ecfe-4be4-ab85-df29d1e410e4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fe75127e-1d72-4277-97bf-938ba396e499 (dataset): DatasetConfig { id: fe75127e-1d72-4277-97bf-938ba396e499 (dataset), name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:603
4502025-01-02T23:29:50.946ZINFOSledAgent (StorageManager): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512025-01-02T23:29:50.946ZINFOSledAgent (StorageManager): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4522025-01-02T23:29:50.946ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:905 request = datasets_ensure
4532025-01-02T23:29:50.946ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4542025-01-02T23:29:50.946ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3422f079-8bbb-4453-89ec-a156fe56575a/crypt/zone/oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265"), full_name: "oxp_3422f079-8bbb-4453-89ec-a156fe56575a/crypt/zone/oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265" } file = sled-storage/src/manager.rs:1331
4552025-01-02T23:29:51.061ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4562025-01-02T23:29:51.061ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd42dc62-762a-4947-84e6-57025e292015/crypt/zone/oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3"), full_name: "oxp_bd42dc62-762a-4947-84e6-57025e292015/crypt/zone/oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3" } file = sled-storage/src/manager.rs:1331
4572025-01-02T23:29:51.171ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4582025-01-02T23:29:51.172ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/clickhouse" } file = sled-storage/src/manager.rs:1331
4592025-01-02T23:29:51.280ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4602025-01-02T23:29:51.280ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
4612025-01-02T23:29:51.384ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4622025-01-02T23:29:51.384ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/761fec61-ade0-4579-af52-842b38e6e3a3/crypt/zone"), full_name: "oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crypt/zone" } file = sled-storage/src/manager.rs:1331
4632025-01-02T23:29:51.463ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4642025-01-02T23:29:51.463ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone"), full_name: "oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone" } file = sled-storage/src/manager.rs:1331
4652025-01-02T23:29:51.543ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4662025-01-02T23:29:51.543ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4672025-01-02T23:29:51.655ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4682025-01-02T23:29:51.655ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb" } file = sled-storage/src/manager.rs:1331
4692025-01-02T23:29:51.705ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4702025-01-02T23:29:51.772ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4712025-01-02T23:29:51.772ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/zone/oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120"), full_name: "oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/zone/oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120" } file = sled-storage/src/manager.rs:1331
4722025-01-02T23:29:51.891ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4732025-01-02T23:29:51.891ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3422f079-8bbb-4453-89ec-a156fe56575a/crypt/debug"), full_name: "oxp_3422f079-8bbb-4453-89ec-a156fe56575a/crypt/debug" } file = sled-storage/src/manager.rs:1331
4742025-01-02T23:29:51.972ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4752025-01-02T23:29:51.972ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/debug"), full_name: "oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/debug" } file = sled-storage/src/manager.rs:1331
4762025-01-02T23:29:52.053ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4772025-01-02T23:29:52.053ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575" } file = sled-storage/src/manager.rs:1331
4782025-01-02T23:29:52.170ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4792025-01-02T23:29:52.170ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/zone/oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2"), full_name: "oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/zone/oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2" } file = sled-storage/src/manager.rs:1331
4802025-01-02T23:29:52.289ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4812025-01-02T23:29:52.289ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242" } file = sled-storage/src/manager.rs:1331
4822025-01-02T23:29:52.404ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4832025-01-02T23:29:52.404ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee" } file = sled-storage/src/manager.rs:1331
4842025-01-02T23:29:52.522ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4852025-01-02T23:29:52.522ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/debug"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/debug" } file = sled-storage/src/manager.rs:1331
4862025-01-02T23:29:52.604ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4872025-01-02T23:29:52.604ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
4882025-01-02T23:29:52.707ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
4892025-01-02T23:29:52.715ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4902025-01-02T23:29:52.715ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crucible" } file = sled-storage/src/manager.rs:1331
4912025-01-02T23:29:52.823ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4922025-01-02T23:29:52.823ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/debug"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/debug" } file = sled-storage/src/manager.rs:1331
4932025-01-02T23:29:52.905ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4942025-01-02T23:29:52.905ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crucible" } file = sled-storage/src/manager.rs:1331
4952025-01-02T23:29:53.014ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4962025-01-02T23:29:53.015ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974" } file = sled-storage/src/manager.rs:1331
4972025-01-02T23:29:53.132ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
4982025-01-02T23:29:53.132ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/debug"), full_name: "oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/debug" } file = sled-storage/src/manager.rs:1331
4992025-01-02T23:29:53.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5002025-01-02T23:29:53.212ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6" } file = sled-storage/src/manager.rs:1331
5012025-01-02T23:29:53.330ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5022025-01-02T23:29:53.331ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1" } file = sled-storage/src/manager.rs:1331
5032025-01-02T23:29:53.447ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5042025-01-02T23:29:53.447ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd42dc62-762a-4947-84e6-57025e292015/crypt/zone/oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b"), full_name: "oxp_bd42dc62-762a-4947-84e6-57025e292015/crypt/zone/oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b" } file = sled-storage/src/manager.rs:1331
5052025-01-02T23:29:53.569ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5062025-01-02T23:29:53.569ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5/crucible" } file = sled-storage/src/manager.rs:1331
5072025-01-02T23:29:53.675ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5082025-01-02T23:29:53.675ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5092025-01-02T23:29:53.709ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
5102025-01-02T23:29:53.794ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5112025-01-02T23:29:53.794ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5122025-01-02T23:29:53.917ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5132025-01-02T23:29:53.917ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/zone/oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), full_name: "oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/zone/oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846" } file = sled-storage/src/manager.rs:1331
5142025-01-02T23:29:54.047ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5152025-01-02T23:29:54.047ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone/oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7" } file = sled-storage/src/manager.rs:1331
5162025-01-02T23:29:54.151ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5172025-01-02T23:29:54.151ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d/crucible" } file = sled-storage/src/manager.rs:1331
5182025-01-02T23:29:54.251ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5192025-01-02T23:29:54.252ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/761fec61-ade0-4579-af52-842b38e6e3a3/crypt/zone/oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38"), full_name: "oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crypt/zone/oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38" } file = sled-storage/src/manager.rs:1331
5202025-01-02T23:29:54.370ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5212025-01-02T23:29:54.370ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/761fec61-ade0-4579-af52-842b38e6e3a3/crypt/debug"), full_name: "oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crypt/debug" } file = sled-storage/src/manager.rs:1331
5222025-01-02T23:29:54.465ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5232025-01-02T23:29:54.465ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone/oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8"), full_name: "oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone/oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8" } file = sled-storage/src/manager.rs:1331
5242025-01-02T23:29:54.586ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5252025-01-02T23:29:54.586ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone/oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc"), full_name: "oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone/oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc" } file = sled-storage/src/manager.rs:1331
5262025-01-02T23:29:54.705ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5272025-01-02T23:29:54.705ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/zone/oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b"), full_name: "oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/zone/oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b" } file = sled-storage/src/manager.rs:1331
5282025-01-02T23:29:54.711ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
5292025-01-02T23:29:54.822ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5302025-01-02T23:29:54.822ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd42dc62-762a-4947-84e6-57025e292015/crypt/zone"), full_name: "oxp_bd42dc62-762a-4947-84e6-57025e292015/crypt/zone" } file = sled-storage/src/manager.rs:1331
5312025-01-02T23:29:54.904ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5322025-01-02T23:29:54.904ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5332025-01-02T23:29:55.014ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5342025-01-02T23:29:55.014ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone/oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc"), full_name: "oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone/oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc" } file = sled-storage/src/manager.rs:1331
5352025-01-02T23:29:55.130ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5362025-01-02T23:29:55.130ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/zone/oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a"), full_name: "oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/zone/oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a" } file = sled-storage/src/manager.rs:1331
5372025-01-02T23:29:55.245ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5382025-01-02T23:29:55.245ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/zone/oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4"), full_name: "oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/zone/oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4" } file = sled-storage/src/manager.rs:1331
5392025-01-02T23:29:55.362ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5402025-01-02T23:29:55.362ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176" } file = sled-storage/src/manager.rs:1331
5412025-01-02T23:29:55.478ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5422025-01-02T23:29:55.478ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3422f079-8bbb-4453-89ec-a156fe56575a/crypt/zone"), full_name: "oxp_3422f079-8bbb-4453-89ec-a156fe56575a/crypt/zone" } file = sled-storage/src/manager.rs:1331
5432025-01-02T23:29:55.535ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10904854175205426194 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
5442025-01-02T23:29:55.536ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12534306702777875675 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
5452025-01-02T23:29:55.561ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5462025-01-02T23:29:55.561ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/zone"), full_name: "oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/zone" } file = sled-storage/src/manager.rs:1331
5472025-01-02T23:29:55.644ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5482025-01-02T23:29:55.644ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone/oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0"), full_name: "oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/zone/oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0" } file = sled-storage/src/manager.rs:1331
5492025-01-02T23:29:55.716ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
5502025-01-02T23:29:55.751ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5512025-01-02T23:29:55.751ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crypt/debug"), full_name: "oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crypt/debug" } file = sled-storage/src/manager.rs:1331
5522025-01-02T23:29:55.826ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5532025-01-02T23:29:55.826ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crypt/internal_dns" } file = sled-storage/src/manager.rs:1331
5542025-01-02T23:29:55.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5552025-01-02T23:29:55.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crucible" } file = sled-storage/src/manager.rs:1331
5562025-01-02T23:29:56.012ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4292
5572025-01-02T23:29:56.012ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4302 gateway = fd00:1122:3344:101::1
5582025-01-02T23:29:56.021ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4316 gateway = fd00:1122:3344:101::1
5592025-01-02T23:29:56.021ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4381
5602025-01-02T23:29:56.038ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5612025-01-02T23:29:56.038ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_3422f079-8bbb-4453-89ec-a156fe56575a/crucible" } file = sled-storage/src/manager.rs:1331
5622025-01-02T23:29:56.157ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5632025-01-02T23:29:56.157ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bd42dc62-762a-4947-84e6-57025e292015/crucible" } file = sled-storage/src/manager.rs:1331
5642025-01-02T23:29:56.177ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4447
5652025-01-02T23:29:56.177ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4474
5662025-01-02T23:29:56.221ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4487
5672025-01-02T23:29:56.221ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4333
5682025-01-02T23:29:56.270ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5692025-01-02T23:29:56.270ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/3422f079-8bbb-4453-89ec-a156fe56575a/crypt/zone/oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5"), full_name: "oxp_3422f079-8bbb-4453-89ec-a156fe56575a/crypt/zone/oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5" } file = sled-storage/src/manager.rs:1331
5702025-01-02T23:29:56.275ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4375
5712025-01-02T23:29:56.275ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4454 rack_subnet = fd00:1122:3344::
5722025-01-02T23:29:56.295ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4465
5732025-01-02T23:29:56.295ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4507
5742025-01-02T23:29:56.368ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4539
5752025-01-02T23:29:56.368ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4545
5762025-01-02T23:29:56.395ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5772025-01-02T23:29:56.396ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/debug"), full_name: "oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/debug" } file = sled-storage/src/manager.rs:1331
5782025-01-02T23:29:56.464ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4586
5792025-01-02T23:29:56.464ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
5802025-01-02T23:29:56.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5812025-01-02T23:29:56.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crucible" } file = sled-storage/src/manager.rs:1331
5822025-01-02T23:29:56.506ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
5832025-01-02T23:29:56.507ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/nexus.rs:527 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
5842025-01-02T23:29:56.544ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
5852025-01-02T23:29:56.544ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
5862025-01-02T23:29:56.545ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
5872025-01-02T23:29:56.545ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.1.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
5882025-01-02T23:29:56.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
5892025-01-02T23:29:56.593ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5902025-01-02T23:29:56.593ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone" } file = sled-storage/src/manager.rs:1331
5912025-01-02T23:29:56.680ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5922025-01-02T23:29:56.680ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/zone/oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8" } file = sled-storage/src/manager.rs:1331
5932025-01-02T23:29:56.720ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
5942025-01-02T23:29:56.798ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5952025-01-02T23:29:56.798ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1331
5962025-01-02T23:29:56.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
5972025-01-02T23:29:56.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crucible" } file = sled-storage/src/manager.rs:1331
5982025-01-02T23:29:57.009ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
5992025-01-02T23:29:57.010ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
6002025-01-02T23:29:57.015ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6012025-01-02T23:29:57.015ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
6022025-01-02T23:29:57.122ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6032025-01-02T23:29:57.122ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crypt/zone/oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660"), full_name: "oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crypt/zone/oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660" } file = sled-storage/src/manager.rs:1331
6042025-01-02T23:29:57.235ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6052025-01-02T23:29:57.235ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/761fec61-ade0-4579-af52-842b38e6e3a3/crypt/zone/oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5"), full_name: "oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crypt/zone/oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5" } file = sled-storage/src/manager.rs:1331
6062025-01-02T23:29:57.346ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6072025-01-02T23:29:57.346ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/external_dns" } file = sled-storage/src/manager.rs:1331
6082025-01-02T23:29:57.453ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6092025-01-02T23:29:57.453ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crypt/zone"), full_name: "oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crypt/zone" } file = sled-storage/src/manager.rs:1331
6102025-01-02T23:29:57.530ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6112025-01-02T23:29:57.530ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/761fec61-ade0-4579-af52-842b38e6e3a3/crypt/zone/oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6"), full_name: "oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crypt/zone/oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6" } file = sled-storage/src/manager.rs:1331
6122025-01-02T23:29:57.643ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6132025-01-02T23:29:57.643ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone"), full_name: "oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/zone" } file = sled-storage/src/manager.rs:1331
6142025-01-02T23:29:57.720ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6152025-01-02T23:29:57.720ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/zone"), full_name: "oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/zone" } file = sled-storage/src/manager.rs:1331
6162025-01-02T23:29:57.724ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
6172025-01-02T23:29:57.793ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:949 request = datasets_ensure
6182025-01-02T23:29:57.793ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bd42dc62-762a-4947-84e6-57025e292015/crypt/debug"), full_name: "oxp_bd42dc62-762a-4947-84e6-57025e292015/crypt/debug" } file = sled-storage/src/manager.rs:1331
6192025-01-02T23:29:57.867ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6202025-01-02T23:29:57.867ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6212025-01-02T23:29:57.867ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:603
6222025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6232025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
6242025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6252025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
6262025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6272025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
6282025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6292025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
6302025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6312025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
6322025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6332025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
6342025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6352025-01-02T23:29:57.867ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
6362025-01-02T23:29:57.868ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6372025-01-02T23:29:57.868ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
6382025-01-02T23:29:57.868ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6392025-01-02T23:29:57.868ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
6402025-01-02T23:29:57.868ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6412025-01-02T23:29:57.868ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
6422025-01-02T23:29:57.868ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6432025-01-02T23:29:57.868ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
6442025-01-02T23:29:57.868ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:864 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
6452025-01-02T23:29:57.868ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6922098 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37014 req_id = b954160a-0331-47d8-9906-7eaf980f133e response_code = 200 uri = /datasets
6462025-01-02T23:29:57.899ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 21a27c6b-77bd-4944-8154-b74f56d79cee (service), filesystem_pool: Some(ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: edeee364-a24a-4b1f-a2f2-141a71f809d6 (service), filesystem_pool: Some(ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38 (service), filesystem_pool: Some(ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6472025-01-02T23:29:57.899ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62099
6482025-01-02T23:29:57.899ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 21a27c6b-77bd-4944-8154-b74f56d79cee, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6492025-01-02T23:29:57.899ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 21a27c6b-77bd-4944-8154-b74f56d79cee, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
6502025-01-02T23:29:57.933ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edeee364-a24a-4b1f-a2f2-141a71f809d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6512025-01-02T23:29:57.933ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edeee364-a24a-4b1f-a2f2-141a71f809d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6522025-01-02T23:29:57.968ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
6532025-01-02T23:29:57.968ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6542025-01-02T23:29:57.999ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6552025-01-02T23:29:57.999ZINFOSledAgent (ServiceManager): No ledger in /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:188
6562025-01-02T23:29:57.999ZINFOSledAgent (ServiceManager): No ledger in /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:188
6572025-01-02T23:29:57.999ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6582025-01-02T23:29:58.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6592025-01-02T23:29:58.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6602025-01-02T23:29:58.045ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
6612025-01-02T23:29:58.103ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee file = illumos-utils/src/zone.rs:325
6622025-01-02T23:29:58.107ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38 file = illumos-utils/src/zone.rs:325
6632025-01-02T23:29:58.112ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6 file = illumos-utils/src/zone.rs:325
6642025-01-02T23:29:58.117ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 13.23413205s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
6652025-01-02T23:29:58.123ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee file = illumos-utils/src/zone.rs:363
6662025-01-02T23:29:58.128ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38 file = illumos-utils/src/zone.rs:363
6672025-01-02T23:29:58.133ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6 file = illumos-utils/src/zone.rs:363
6682025-01-02T23:29:58.507ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/nexus.rs:527 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
6692025-01-02T23:29:58.726ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
6702025-01-02T23:29:59.707ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6712025-01-02T23:30:00.187ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6722025-01-02T23:30:00.187ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6732025-01-02T23:30:00.667ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6742025-01-02T23:30:00.667ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6752025-01-02T23:30:00.667ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6762025-01-02T23:30:00.667ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
6772025-01-02T23:30:00.672ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
6782025-01-02T23:30:00.677ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
6792025-01-02T23:30:00.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee") failed: Property not found. retry in 41.548074ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
6802025-01-02T23:30:00.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38") failed: Property not found. retry in 63.495697ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
6812025-01-02T23:30:00.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6") failed: Property not found. retry in 62.935606ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
6822025-01-02T23:30:00.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee") failed: Property not found. retry in 83.499267ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
6832025-01-02T23:30:00.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38") failed: Property not found. retry in 109.568721ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
6842025-01-02T23:30:01.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6") failed: Property not found. retry in 112.901944ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
6852025-01-02T23:30:01.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee") failed: Property not found. retry in 112.40886ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
6862025-01-02T23:30:01.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38") failed: Property not found. retry in 117.158788ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
6872025-01-02T23:30:01.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6") failed: Property not found. retry in 221.488062ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
6882025-01-02T23:30:01.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee") failed: Property not found. retry in 262.450379ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
6892025-01-02T23:30:01.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38") failed: Property not found. retry in 570.5577ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
6902025-01-02T23:30:01.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6") failed: Property not found. retry in 249.182593ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
6912025-01-02T23:30:01.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee") failed: Property not found. retry in 1.199172389s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
6922025-01-02T23:30:01.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6") failed: Property not found. retry in 961.601388ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
6932025-01-02T23:30:01.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38") failed: Property not found. retry in 822.560505ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
6942025-01-02T23:30:02.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6") failed: Property not found. retry in 1.173308489s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
6952025-01-02T23:30:02.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38") failed: Property not found. retry in 1.3996565s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
6962025-01-02T23:30:02.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee") failed: Property not found. retry in 1.198968635s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
6972025-01-02T23:30:03.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6") failed: Property not found. retry in 1.358495026s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
6982025-01-02T23:30:03.981ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee") failed: Property not found. retry in 632.938343ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
6992025-01-02T23:30:04.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38") failed: Property not found. retry in 1.046208982s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
7002025-01-02T23:30:04.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee") failed: Property not found. retry in 945.516333ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
7012025-01-02T23:30:05.178ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6") failed: Property not found. retry in 815.321421ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
7022025-01-02T23:30:05.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38") failed: Property not found. retry in 1.160063613s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
7032025-01-02T23:30:05.537ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10904854175205426194 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7042025-01-02T23:30:05.537ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12534306702777875675 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7052025-01-02T23:30:05.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee") failed: Property not found. retry in 814.324746ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
7062025-01-02T23:30:06.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6") failed: Property not found. retry in 540.627096ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
7072025-01-02T23:30:06.563ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_21a27c6b-77bd-4944-8154-b74f56d79cee
7082025-01-02T23:30:06.564ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38
7092025-01-02T23:30:06.564ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_internal_dns_edeee364-a24a-4b1f-a2f2-141a71f809d6
7102025-01-02T23:30:06.564ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7112025-01-02T23:30:06.564ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7122025-01-02T23:30:06.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8665002 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62099 req_id = 18d88c2d-7f96-4547-9eb3-2c78aeb83e53 response_code = 204 uri = /omicron-zones
7132025-01-02T23:30:06.567ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7142025-01-02T23:30:07.012ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7152025-01-02T23:30:07.012ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7162025-01-02T23:30:07.264ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 134.685704ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7172025-01-02T23:30:07.426ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7182025-01-02T23:30:07.480ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7192025-01-02T23:30:07.536ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7202025-01-02T23:30:07.536ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7212025-01-02T23:30:07.569ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7222025-01-02T23:30:07.570ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7232025-01-02T23:30:07.570ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7242025-01-02T23:30:07.600ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 21a27c6b-77bd-4944-8154-b74f56d79cee (service), filesystem_pool: Some(ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: edeee364-a24a-4b1f-a2f2-141a71f809d6 (service), filesystem_pool: Some(ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38 (service), filesystem_pool: Some(ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b (service), filesystem_pool: Some(ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9e4b877c-f466-41d4-bd53-6cc6b25c439e, kind: Service { id: e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b }, name: Name("ntp-e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 172])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7252025-01-02T23:30:07.600ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36940
7262025-01-02T23:30:07.600ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 21a27c6b-77bd-4944-8154-b74f56d79cee, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7272025-01-02T23:30:07.600ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 21a27c6b-77bd-4944-8154-b74f56d79cee, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
7282025-01-02T23:30:07.643ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edeee364-a24a-4b1f-a2f2-141a71f809d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7292025-01-02T23:30:07.643ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edeee364-a24a-4b1f-a2f2-141a71f809d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7302025-01-02T23:30:07.682ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
7312025-01-02T23:30:07.682ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7322025-01-02T23:30:07.719ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7332025-01-02T23:30:07.719ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
7342025-01-02T23:30:07.719ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
7352025-01-02T23:30:07.720ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7362025-01-02T23:30:07.731ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7372025-01-02T23:30:07.763ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7382025-01-02T23:30:07.764ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7392025-01-02T23:30:07.764ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7402025-01-02T23:30:07.794ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 218, 172]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7412025-01-02T23:30:07.794ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = boundary_ntp
7422025-01-02T23:30:07.795ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:83
7432025-01-02T23:30:07.795ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:90
7442025-01-02T23:30:07.795ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.169 file = clients/dpd-client/src/lib.rs:118
7452025-01-02T23:30:07.795ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
7462025-01-02T23:30:07.819ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b file = illumos-utils/src/zone.rs:325
7472025-01-02T23:30:07.836ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b file = illumos-utils/src/zone.rs:363
7482025-01-02T23:30:08.456ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7492025-01-02T23:30:08.456ZINFOSledAgent (ServiceManager): Booting oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7502025-01-02T23:30:08.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 29.702136ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7512025-01-02T23:30:08.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 101.999855ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7522025-01-02T23:30:08.738ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 282.504587ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7532025-01-02T23:30:09.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 548.21302ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7542025-01-02T23:30:09.590ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 562.431947ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7552025-01-02T23:30:10.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 1.379501899s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7562025-01-02T23:30:11.552ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 565.710624ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7572025-01-02T23:30:12.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 623.941877ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7582025-01-02T23:30:12.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 601.575733ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7592025-01-02T23:30:13.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b") failed: Property not found. retry in 827.461905ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7602025-01-02T23:30:14.227ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b
7612025-01-02T23:30:14.227ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7622025-01-02T23:30:14.228ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7632025-01-02T23:30:14.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6628225 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36940 req_id = d407409b-856b-435f-a847-22fe4f6646a2 response_code = 204 uri = /omicron-zones
7642025-01-02T23:30:14.230ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
7652025-01-02T23:30:14.260ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7662025-01-02T23:30:14.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46923
7672025-01-02T23:30:14.269ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7682025-01-02T23:30:14.269ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46923 req_id = ab338a01-7c2f-493a-a333-d3e561eb2274 response_code = 500 uri = /timesync
7692025-01-02T23:30:14.271ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7702025-01-02T23:30:14.401ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7712025-01-02T23:30:14.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38302
7722025-01-02T23:30:15.540ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10904854175205426194 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7732025-01-02T23:30:15.540ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12534306702777875675 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7742025-01-02T23:30:16.378ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13075927708976596995 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7752025-01-02T23:30:16.412ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8836915484589662593 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7762025-01-02T23:30:16.566ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17046946280589049266 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7772025-01-02T23:30:17.014ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7782025-01-02T23:30:17.014ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
7792025-01-02T23:30:18.410ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7802025-01-02T23:30:18.410ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4008997 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38302 req_id = df5f5497-cff8-48c8-bc50-a4f44c2317d3 response_code = 500 uri = /timesync
7812025-01-02T23:30:18.412ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7822025-01-02T23:30:18.506ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7832025-01-02T23:30:18.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64428
7842025-01-02T23:30:18.514ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7852025-01-02T23:30:18.514ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64428 req_id = 0532834e-03a8-4204-8eed-5c2dc30ebcbd response_code = 500 uri = /timesync
7862025-01-02T23:30:18.518ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7872025-01-02T23:30:18.742ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7882025-01-02T23:30:18.742ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46461
7892025-01-02T23:30:18.751ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3900
7902025-01-02T23:30:18.751ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 8925 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46461 req_id = f81b59b2-d996-4c65-a785-9f0878516b8f response_code = 500 uri = /timesync
7912025-01-02T23:30:18.753ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7922025-01-02T23:30:18.890ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7932025-01-02T23:30:18.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54134
7942025-01-02T23:30:20.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2008396 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54134 req_id = dde6e1fc-a765-4ff9-92c7-9d9b9b8328f0 response_code = 200 uri = /timesync
7952025-01-02T23:30:20.901ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
7962025-01-02T23:30:20.901ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
7972025-01-02T23:30:21.053ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
7982025-01-02T23:30:21.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63491
7992025-01-02T23:30:21.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8600 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63491 req_id = 502702dc-dc17-4d60-9d06-f1d3f1f5bb6b response_code = 200 uri = /timesync
8002025-01-02T23:30:21.065ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8012025-01-02T23:30:21.065ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8022025-01-02T23:30:21.441ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8032025-01-02T23:30:21.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64312
8042025-01-02T23:30:21.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8030 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64312 req_id = 123cf223-97cc-4258-ae04-ab20cbe152b0 response_code = 200 uri = /timesync
8052025-01-02T23:30:21.451ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8062025-01-02T23:30:21.451ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8072025-01-02T23:30:22.081ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8082025-01-02T23:30:22.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55170
8092025-01-02T23:30:22.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8047 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55170 req_id = 0f5ebe16-af5b-4b6f-a9b8-4bbc871977ae response_code = 200 uri = /timesync
8102025-01-02T23:30:22.092ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.389718086 } file = sled-agent/src/rack_setup/service.rs:743
8112025-01-02T23:30:22.092ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8122025-01-02T23:30:22.356ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8132025-01-02T23:30:22.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35531
8142025-01-02T23:30:22.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7337 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35531 req_id = cdd577c9-eaa9-4e7a-8a93-31fd4fecb71b response_code = 200 uri = /timesync
8152025-01-02T23:30:22.367ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.388973475 } file = sled-agent/src/rack_setup/service.rs:743
8162025-01-02T23:30:22.367ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8172025-01-02T23:30:22.662ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8182025-01-02T23:30:22.662ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59426
8192025-01-02T23:30:22.670ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8411 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59426 req_id = c83748bc-9703-4632-ac6d-eb196d67a482 response_code = 200 uri = /timesync
8202025-01-02T23:30:22.672ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860622.1565454, correction: -0.3798576 } file = sled-agent/src/rack_setup/service.rs:743
8212025-01-02T23:30:22.672ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8222025-01-02T23:30:23.018ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8232025-01-02T23:30:23.018ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33503
8242025-01-02T23:30:23.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33503 req_id = d0775d17-ce9f-42ae-85a0-7309b32f7748 response_code = 200 uri = /timesync
8252025-01-02T23:30:23.030ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1735860620.9841945, correction: -0.378890753 } file = sled-agent/src/rack_setup/service.rs:743
8262025-01-02T23:30:23.030ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8272025-01-02T23:30:23.427ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8282025-01-02T23:30:23.427ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39755
8292025-01-02T23:30:23.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7333 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39755 req_id = b5fdd113-0064-46e6-8e96-eba5439ed93e response_code = 200 uri = /timesync
8302025-01-02T23:30:23.438ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1735860620.9841945, correction: -0.377782494 } file = sled-agent/src/rack_setup/service.rs:743
8312025-01-02T23:30:23.438ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8322025-01-02T23:30:24.327ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8332025-01-02T23:30:24.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54396
8342025-01-02T23:30:24.335ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54396 req_id = 7fcc83bf-f2ed-4691-88d5-95f484958480 response_code = 200 uri = /timesync
8352025-01-02T23:30:24.337ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1735860620.9841945, correction: -0.373776495 } file = sled-agent/src/rack_setup/service.rs:743
8362025-01-02T23:30:24.337ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372025-01-02T23:30:24.482ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17644602720773063191 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8382025-01-02T23:30:24.482ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15641120130063694019 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8392025-01-02T23:30:25.301ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8402025-01-02T23:30:25.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63401
8412025-01-02T23:30:25.309ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7925 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63401 req_id = 26713a82-b1c5-4fd8-8e72-28eeace5784a response_code = 200 uri = /timesync
8422025-01-02T23:30:25.311ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1735860620.9841945, correction: -0.371412426 } file = sled-agent/src/rack_setup/service.rs:743
8432025-01-02T23:30:25.311ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8442025-01-02T23:30:25.789ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10904854175205426194 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8452025-01-02T23:30:25.789ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12534306702777875675 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8462025-01-02T23:30:26.473ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64290
8472025-01-02T23:30:26.473ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64290 req_id = 0fe84b98-c728-40c9-8009-9ec8e1aef1a4 response_code = 200 uri = /baseboard
8482025-01-02T23:30:26.601ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492025-01-02T23:30:26.601ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:48709
8502025-01-02T23:30:26.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8088 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:48709 req_id = 655e646c-6ddd-4635-97be-e4c142342512 response_code = 200 uri = /timesync
8512025-01-02T23:30:26.612ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1735860620.9841945, correction: -0.364921778 } file = sled-agent/src/rack_setup/service.rs:743
8522025-01-02T23:30:26.612ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-01-02T23:30:26.627ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13075927708976596995 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8542025-01-02T23:30:26.635ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 362.13625ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8552025-01-02T23:30:26.660ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8836915484589662593 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8562025-01-02T23:30:26.812ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17046946280589049266 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8572025-01-02T23:30:27.259ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8582025-01-02T23:30:27.260ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8592025-01-02T23:30:27.356ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8602025-01-02T23:30:27.356ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54839
8612025-01-02T23:30:27.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8542 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54839 req_id = 9ba870c9-71c7-42cc-8bac-6a3aee9b19b2 response_code = 200 uri = /timesync
8622025-01-02T23:30:27.367ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860625.338728, correction: -0.36291647 } file = sled-agent/src/rack_setup/service.rs:743
8632025-01-02T23:30:27.367ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8642025-01-02T23:30:29.597ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8652025-01-02T23:30:29.597ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60460
8662025-01-02T23:30:29.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9075 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60460 req_id = 5d31922a-15af-474e-a967-62d105d8df70 response_code = 200 uri = /timesync
8672025-01-02T23:30:29.608ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860628.0247345, correction: -0.35651353 } file = sled-agent/src/rack_setup/service.rs:743
8682025-01-02T23:30:29.608ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8692025-01-02T23:30:31.859ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8702025-01-02T23:30:31.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54072
8712025-01-02T23:30:31.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54072 req_id = 4a16f96f-f902-443c-b96e-0d107a0e94ba response_code = 200 uri = /timesync
8722025-01-02T23:30:31.871ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860630.829364, correction: -0.349599481 } file = sled-agent/src/rack_setup/service.rs:743
8732025-01-02T23:30:31.871ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8742025-01-02T23:30:34.457ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17644602720773063191 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8752025-01-02T23:30:34.457ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15641120130063694019 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8762025-01-02T23:30:34.786ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8772025-01-02T23:30:34.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57406
8782025-01-02T23:30:34.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9418 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57406 req_id = c194eb9e-48ba-47a6-98f9-c7d5de4f31e7 response_code = 200 uri = /timesync
8792025-01-02T23:30:34.798ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860633.8229098, correction: -0.341690481 } file = sled-agent/src/rack_setup/service.rs:743
8802025-01-02T23:30:34.798ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8812025-01-02T23:30:35.764ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10904854175205426194 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8822025-01-02T23:30:35.764ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12534306702777875675 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8832025-01-02T23:30:36.602ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13075927708976596995 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8842025-01-02T23:30:36.634ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8836915484589662593 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8852025-01-02T23:30:36.785ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17046946280589049266 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8862025-01-02T23:30:37.234ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8872025-01-02T23:30:37.234ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8882025-01-02T23:30:38.701ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8892025-01-02T23:30:38.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58706
8902025-01-02T23:30:38.711ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9308 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58706 req_id = df1ac9f0-b40d-4cf4-bb7c-77297fddefeb response_code = 200 uri = /timesync
8912025-01-02T23:30:38.713ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860636.9230888, correction: -0.330955416 } file = sled-agent/src/rack_setup/service.rs:743
8922025-01-02T23:30:38.713ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8932025-01-02T23:30:41.991ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 412.470612ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
8942025-01-02T23:30:42.999ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8952025-01-02T23:30:42.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58796
8962025-01-02T23:30:43.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8902 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58796 req_id = 10d136b5-484e-433f-b9c4-a7ba82e49423 response_code = 200 uri = /timesync
8972025-01-02T23:30:43.011ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860642.158386, correction: -0.319010019 } file = sled-agent/src/rack_setup/service.rs:743
8982025-01-02T23:30:43.011ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8992025-01-02T23:30:44.432ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17644602720773063191 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9002025-01-02T23:30:44.432ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15641120130063694019 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9012025-01-02T23:30:45.739ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10904854175205426194 reason = Duration(60s) sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9022025-01-02T23:30:45.739ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 12534306702777875675 reason = Duration(60s) sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9032025-01-02T23:30:46.576ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13075927708976596995 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9042025-01-02T23:30:46.608ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8836915484589662593 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9052025-01-02T23:30:46.759ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17046946280589049266 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9062025-01-02T23:30:47.209ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9072025-01-02T23:30:47.209ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9082025-01-02T23:30:47.284ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9092025-01-02T23:30:47.284ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60824
9102025-01-02T23:30:47.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8530 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60824 req_id = 5d13fe03-da40-42b9-b5a6-2388fa2bcb44 response_code = 200 uri = /timesync
9112025-01-02T23:30:47.295ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860645.5556238, correction: -0.307387501 } file = sled-agent/src/rack_setup/service.rs:743
9122025-01-02T23:30:47.295ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9132025-01-02T23:30:51.527ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9142025-01-02T23:30:51.528ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42517
9152025-01-02T23:30:51.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8691 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42517 req_id = 96a71012-199e-486d-89ef-f56e1a92f435 response_code = 200 uri = /timesync
9162025-01-02T23:30:51.539ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860649.902761, correction: -0.296005696 } file = sled-agent/src/rack_setup/service.rs:743
9172025-01-02T23:30:51.539ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9182025-01-02T23:30:54.407ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17644602720773063191 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9192025-01-02T23:30:54.407ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15641120130063694019 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9202025-01-02T23:30:56.426ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38706
9212025-01-02T23:30:56.426ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:38706 req_id = 3c648d63-2fe6-4a66-bd1a-788b28b4eb6b response_code = 200 uri = /baseboard
9222025-01-02T23:30:56.552ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 13075927708976596995 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9232025-01-02T23:30:56.582ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8836915484589662593 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9242025-01-02T23:30:56.733ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17046946280589049266 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9252025-01-02T23:30:57.184ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9262025-01-02T23:30:57.184ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9272025-01-02T23:30:57.397ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 565.973757ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9282025-01-02T23:30:58.219ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9292025-01-02T23:30:58.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49835
9302025-01-02T23:30:58.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8514 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49835 req_id = 76c328f5-d4b3-4b9f-ae12-1e12577a43a3 response_code = 200 uri = /timesync
9312025-01-02T23:30:58.230ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860657.2400596, correction: -0.277916014 } file = sled-agent/src/rack_setup/service.rs:743
9322025-01-02T23:30:58.230ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9332025-01-02T23:31:04.382ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 17644602720773063191 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9342025-01-02T23:31:04.382ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15641120130063694019 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9352025-01-02T23:31:05.345ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9362025-01-02T23:31:05.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38716
9372025-01-02T23:31:05.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8634 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38716 req_id = 7ab70f7d-8aa8-4c4d-8c67-4b610eba99ca response_code = 200 uri = /timesync
9382025-01-02T23:31:05.357ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860664.4865873, correction: -0.259275824 } file = sled-agent/src/rack_setup/service.rs:743
9392025-01-02T23:31:05.357ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9402025-01-02T23:31:06.527ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 13075927708976596995 reason = Duration(60s) sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9412025-01-02T23:31:06.557ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 8836915484589662593 reason = Duration(60s) sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9422025-01-02T23:31:06.708ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17046946280589049266 reason = Duration(60s) sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9432025-01-02T23:31:07.158ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9442025-01-02T23:31:07.159ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9452025-01-02T23:31:10.835ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9462025-01-02T23:31:10.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43302
9472025-01-02T23:31:10.845ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9834 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43302 req_id = 858a6157-10d4-4dcb-9441-522084cf2f99 response_code = 200 uri = /timesync
9482025-01-02T23:31:10.848ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860668.299359, correction: -0.244083583 } file = sled-agent/src/rack_setup/service.rs:743
9492025-01-02T23:31:10.848ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9502025-01-02T23:31:12.956ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 2.255909304s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9512025-01-02T23:31:14.356ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 17644602720773063191 reason = Duration(60s) sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9522025-01-02T23:31:14.357ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 15641120130063694019 reason = Duration(60s) sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9532025-01-02T23:31:17.133ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9542025-01-02T23:31:17.133ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9552025-01-02T23:31:23.223ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9562025-01-02T23:31:23.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46769
9572025-01-02T23:31:23.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8398 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46769 req_id = b5bbeeec-9dcb-480e-a2f0-03dec5bf907d response_code = 200 uri = /timesync
9582025-01-02T23:31:23.234ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860680.8477352, correction: -0.21034652 } file = sled-agent/src/rack_setup/service.rs:743
9592025-01-02T23:31:23.234ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9602025-01-02T23:31:26.379ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48224
9612025-01-02T23:31:26.379ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48224 req_id = 2fc03052-0f3b-4fd2-8081-6c2d4f83245a response_code = 200 uri = /baseboard
9622025-01-02T23:31:27.108ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9632025-01-02T23:31:27.108ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9642025-01-02T23:31:30.199ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.189973189s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9652025-01-02T23:31:36.808ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9662025-01-02T23:31:36.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53060
9672025-01-02T23:31:36.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8663 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53060 req_id = b4f0a0b6-6cdc-4432-8f96-1635b94d4d2a response_code = 200 uri = /timesync
9682025-01-02T23:31:36.819ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860693.469865, correction: -0.17324084 } file = sled-agent/src/rack_setup/service.rs:743
9692025-01-02T23:31:36.819ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9702025-01-02T23:31:37.083ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9712025-01-02T23:31:37.084ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9722025-01-02T23:31:47.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9732025-01-02T23:31:47.058ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9742025-01-02T23:31:48.376ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.491901008s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9752025-01-02T23:31:55.011ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9762025-01-02T23:31:55.012ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40062
9772025-01-02T23:31:55.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8634 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40062 req_id = 99a85ca8-a7eb-40e0-bee1-a78f34fb15ef response_code = 200 uri = /timesync
9782025-01-02T23:31:55.024ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860714.7731614, correction: -0.123273738 } file = sled-agent/src/rack_setup/service.rs:743
9792025-01-02T23:31:55.024ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9802025-01-02T23:31:56.332ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53192
9812025-01-02T23:31:56.332ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53192 req_id = 9799cf38-5cbc-489f-bc29-69153272de9d response_code = 200 uri = /baseboard
9822025-01-02T23:31:57.033ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9832025-01-02T23:31:57.034ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9842025-01-02T23:32:07.009ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9852025-01-02T23:32:07.009ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9862025-01-02T23:32:07.850ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 22.602350511s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9872025-01-02T23:32:13.521ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9882025-01-02T23:32:13.521ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47870
9892025-01-02T23:32:13.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47870 req_id = c1d00e8c-7873-419e-aa60-683503329d6c response_code = 200 uri = /timesync
9902025-01-02T23:32:13.533ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860731.0620108, correction: -0.072916381 } file = sled-agent/src/rack_setup/service.rs:743
9912025-01-02T23:32:13.533ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9922025-01-02T23:32:16.984ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9932025-01-02T23:32:16.984ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9942025-01-02T23:32:26.285ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33336
9952025-01-02T23:32:26.285ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33336 req_id = cd308c55-291e-4a3d-ac60-7472d226b8a1 response_code = 200 uri = /baseboard
9962025-01-02T23:32:26.959ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9972025-01-02T23:32:26.959ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
9982025-01-02T23:32:36.943ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9992025-01-02T23:32:36.943ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57102
10002025-01-02T23:32:36.947ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14428274626015221508 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10012025-01-02T23:32:36.948ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 2358760306414287013 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10022025-01-02T23:32:36.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 20897 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57102 req_id = 6311737f-17cb-4f47-87c3-e03fa09d5536 response_code = 200 uri = /timesync
10032025-01-02T23:32:36.964ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-02T23:30:45.739006416Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10904854175205426194 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10042025-01-02T23:32:36.966ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-02T23:31:06.708333242Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17046946280589049266 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10052025-01-02T23:32:36.966ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-02T23:31:14.356834025Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 17644602720773063191 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10062025-01-02T23:32:36.966ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-02T23:30:45.739765435Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 12534306702777875675 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10072025-01-02T23:32:36.966ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-02T23:31:14.357118959Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 15641120130063694019 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10082025-01-02T23:32:36.967ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-02T23:31:06.527067583Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 13075927708976596995 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10092025-01-02T23:32:36.967ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-02T23:31:06.557391502Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 8836915484589662593 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10102025-01-02T23:32:36.968ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 2305744411, ip_addr: 137.110.222.27, stratum: 3, ref_time: 1735860753.3110168, correction: -0.009340598 } file = sled-agent/src/rack_setup/service.rs:743
10112025-01-02T23:32:36.968ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10122025-01-02T23:32:36.998ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 21a27c6b-77bd-4944-8154-b74f56d79cee (service), filesystem_pool: Some(ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: edeee364-a24a-4b1f-a2f2-141a71f809d6 (service), filesystem_pool: Some(ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38 (service), filesystem_pool: Some(ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b (service), filesystem_pool: Some(ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9e4b877c-f466-41d4-bd53-6cc6b25c439e, kind: Service { id: e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b }, name: Name("ntp-e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 172])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b7d7e3fd-8645-445f-9d22-1af398592575 (service), filesystem_pool: Some(ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } } } }, OmicronZoneConfig { id: e277dedb-b1ac-4d23-a435-66ef92de00eb (service), filesystem_pool: Some(ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ecc1e49-3c64-4dde-9882-928207a785a6 (service), filesystem_pool: Some(ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4 (service), filesystem_pool: Some(ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3c72e847-3356-4d80-93ed-0a28ca2524d2 (service), filesystem_pool: Some(ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10132025-01-02T23:32:36.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54057
10142025-01-02T23:32:36.998ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 21a27c6b-77bd-4944-8154-b74f56d79cee, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10152025-01-02T23:32:36.998ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 21a27c6b-77bd-4944-8154-b74f56d79cee, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
10162025-01-02T23:32:37.032ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edeee364-a24a-4b1f-a2f2-141a71f809d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10172025-01-02T23:32:37.032ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edeee364-a24a-4b1f-a2f2-141a71f809d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10182025-01-02T23:32:37.065ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
10192025-01-02T23:32:37.065ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10202025-01-02T23:32:37.098ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b7d7e3fd-8645-445f-9d22-1af398592575, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10212025-01-02T23:32:37.098ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b7d7e3fd-8645-445f-9d22-1af398592575, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Cockroach }, responder: ... }
10222025-01-02T23:32:37.132ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e277dedb-b1ac-4d23-a435-66ef92de00eb, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10232025-01-02T23:32:37.132ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e277dedb-b1ac-4d23-a435-66ef92de00eb, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10242025-01-02T23:32:37.164ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5ecc1e49-3c64-4dde-9882-928207a785a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10252025-01-02T23:32:37.164ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5ecc1e49-3c64-4dde-9882-928207a785a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10262025-01-02T23:32:37.196ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10272025-01-02T23:32:37.196ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10282025-01-02T23:32:37.228ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c72e847-3356-4d80-93ed-0a28ca2524d2, dataset_name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
10292025-01-02T23:32:37.228ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3c72e847-3356-4d80-93ed-0a28ca2524d2, dataset_name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10302025-01-02T23:32:37.261ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10312025-01-02T23:32:37.261ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
10322025-01-02T23:32:37.261ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
10332025-01-02T23:32:37.261ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10342025-01-02T23:32:37.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10352025-01-02T23:32:37.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10362025-01-02T23:32:37.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10372025-01-02T23:32:37.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10382025-01-02T23:32:37.347ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
10392025-01-02T23:32:37.442ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4 file = illumos-utils/src/zone.rs:325
10402025-01-02T23:32:37.446ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb file = illumos-utils/src/zone.rs:325
10412025-01-02T23:32:37.450ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6 file = illumos-utils/src/zone.rs:325
10422025-01-02T23:32:37.455ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 file = illumos-utils/src/zone.rs:325
10432025-01-02T23:32:37.460ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575 file = illumos-utils/src/zone.rs:325
10442025-01-02T23:32:37.464ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4 file = illumos-utils/src/zone.rs:363
10452025-01-02T23:32:37.469ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb file = illumos-utils/src/zone.rs:363
10462025-01-02T23:32:37.474ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6 file = illumos-utils/src/zone.rs:363
10472025-01-02T23:32:37.478ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 file = illumos-utils/src/zone.rs:363
10482025-01-02T23:32:37.483ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575 file = illumos-utils/src/zone.rs:363
10492025-01-02T23:32:40.417ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b7d7e3fd-8645-445f-9d22-1af398592575'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10502025-01-02T23:32:40.417ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='e277dedb-b1ac-4d23-a435-66ef92de00eb'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10512025-01-02T23:32:40.417ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10522025-01-02T23:32:40.422ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
10532025-01-02T23:32:40.458ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5ecc1e49-3c64-4dde-9882-928207a785a6'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10542025-01-02T23:32:40.458ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
10552025-01-02T23:32:40.520ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='3c72e847-3356-4d80-93ed-0a28ca2524d2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10562025-01-02T23:32:40.520ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
10572025-01-02T23:32:40.539ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10582025-01-02T23:32:40.540ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
10592025-01-02T23:32:40.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 55.917125ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10602025-01-02T23:32:40.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 41.454528ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
10612025-01-02T23:32:40.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 68.216174ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
10622025-01-02T23:32:40.622ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 116.531679ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
10632025-01-02T23:32:40.641ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 72.00023ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10642025-01-02T23:32:40.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 54.17465ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
10652025-01-02T23:32:40.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 170.707815ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
10662025-01-02T23:32:40.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 120.223631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10672025-01-02T23:32:41.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 285.009389ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
10682025-01-02T23:32:41.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 66.394338ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
10692025-01-02T23:32:41.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 350.210909ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10702025-01-02T23:32:41.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 58.976487ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
10712025-01-02T23:32:41.657ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 423.283093ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
10722025-01-02T23:32:41.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 585.465956ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
10732025-01-02T23:32:41.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 74.792258ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
10742025-01-02T23:32:41.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 78.032339ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
10752025-01-02T23:32:41.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 602.89216ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10762025-01-02T23:32:41.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 267.272753ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
10772025-01-02T23:32:41.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 253.179557ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
10782025-01-02T23:32:42.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 564.085816ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
10792025-01-02T23:32:42.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 215.247175ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
10802025-01-02T23:32:42.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 393.108623ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
10812025-01-02T23:32:42.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 672.33212ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
10822025-01-02T23:32:42.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.086381708s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
10832025-01-02T23:32:42.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 852.068036ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10842025-01-02T23:32:43.011ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 1.143287183s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
10852025-01-02T23:32:43.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 1.48978019s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
10862025-01-02T23:32:43.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 1.433262987s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
10872025-01-02T23:32:43.835ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 549.423497ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10882025-01-02T23:32:44.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.481018941s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
10892025-01-02T23:32:44.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 800.829777ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
10902025-01-02T23:32:44.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 1.16516316s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10912025-01-02T23:32:44.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 1.114376052s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
10922025-01-02T23:32:44.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 1.098362985s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
10932025-01-02T23:32:44.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 1.380584337s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
10942025-01-02T23:32:45.400ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 21.192380202s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
10952025-01-02T23:32:45.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.138062366s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
10962025-01-02T23:32:45.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 1.361320557s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
10972025-01-02T23:32:45.677ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 794.714661ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
10982025-01-02T23:32:46.018ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 878.67196ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
10992025-01-02T23:32:46.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 630.032695ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
11002025-01-02T23:32:46.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 935.760877ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11012025-01-02T23:32:46.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.462869386s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11022025-01-02T23:32:46.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 712.23165ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11032025-01-02T23:32:46.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 1.344276697s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11042025-01-02T23:32:47.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 828.021927ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
11052025-01-02T23:32:47.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 607.346244ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11062025-01-02T23:32:47.627ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 969.548049ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11072025-01-02T23:32:47.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 904.360286ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
11082025-01-02T23:32:48.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 701.099236ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11092025-01-02T23:32:48.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.156335215s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11102025-01-02T23:32:48.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 1.479573838s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11112025-01-02T23:32:48.606ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 546.138658ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11122025-01-02T23:32:48.754ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4") failed: Property not found. retry in 607.810248ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
11132025-01-02T23:32:48.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 527.807429ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11142025-01-02T23:32:49.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 1.086027358s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11152025-01-02T23:32:49.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 990.308853ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11162025-01-02T23:32:49.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.367591166s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11172025-01-02T23:32:49.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 1.222363937s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11182025-01-02T23:32:50.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 1.367031893s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11192025-01-02T23:32:50.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 977.171295ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11202025-01-02T23:32:50.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 539.930627ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11212025-01-02T23:32:51.014ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 644.717442ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11222025-01-02T23:32:51.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 628.542631ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11232025-01-02T23:32:51.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 1.219982116s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11242025-01-02T23:32:51.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 1.050699718s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11252025-01-02T23:32:51.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 1.35926169s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11262025-01-02T23:32:51.885ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.127957227s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11272025-01-02T23:32:52.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 1.227496568s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11282025-01-02T23:32:52.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 1.063194223s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11292025-01-02T23:32:53.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.050379404s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11302025-01-02T23:32:53.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 1.287747489s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11312025-01-02T23:32:53.758ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 1.20171273s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11322025-01-02T23:32:53.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 1.091099707s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11332025-01-02T23:32:54.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.492088254s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11342025-01-02T23:32:54.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 1.232749884s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11352025-01-02T23:32:54.868ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 925.596473ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11362025-01-02T23:32:54.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 1.425136084s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11372025-01-02T23:32:55.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 572.178403ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11382025-01-02T23:32:55.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 988.026858ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11392025-01-02T23:32:55.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 1.405347442s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11402025-01-02T23:32:56.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 505.976816ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11412025-01-02T23:32:56.279ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65392
11422025-01-02T23:32:56.279ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65392 req_id = fbc3ea99-1cb6-450d-9995-5e1059b7f92e response_code = 200 uri = /baseboard
11432025-01-02T23:32:56.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 707.540054ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11442025-01-02T23:32:56.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 519.034203ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11452025-01-02T23:32:56.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 1.247540281s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11462025-01-02T23:32:57.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 1.340030102s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11472025-01-02T23:32:57.118ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 1.376632687s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11482025-01-02T23:32:57.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 903.5048ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11492025-01-02T23:32:57.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 624.618731ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11502025-01-02T23:32:58.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6") failed: Property not found. retry in 1.499745898s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11512025-01-02T23:32:58.459ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2") failed: Property not found. retry in 588.11928ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11522025-01-02T23:32:58.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb") failed: Property not found. retry in 1.383651592s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11532025-01-02T23:32:58.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575") failed: Property not found. retry in 831.731251ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11542025-01-02T23:32:59.907ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4
11552025-01-02T23:32:59.907ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_e277dedb-b1ac-4d23-a435-66ef92de00eb
11562025-01-02T23:32:59.907ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_5ecc1e49-3c64-4dde-9882-928207a785a6
11572025-01-02T23:32:59.907ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2
11582025-01-02T23:32:59.907ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_cockroachdb_b7d7e3fd-8645-445f-9d22-1af398592575
11592025-01-02T23:32:59.907ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11602025-01-02T23:32:59.907ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11612025-01-02T23:32:59.907ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22919637 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54057 req_id = 38116303-ff49-453e-b01f-ac4218c5039d response_code = 204 uri = /omicron-zones
11622025-01-02T23:32:59.941ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44491
11632025-01-02T23:32:59.969ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28156 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = 53e4ffff-f331-4246-90ec-3d7db6cec2e8 response_code = 500 uri = /cockroachdb
11642025-01-02T23:32:59.970ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "53e4ffff-f331-4246-90ec-3d7db6cec2e8", "content-length": "124", "date": "Thu, 02 Jan 2025 23:32:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "53e4ffff-f331-4246-90ec-3d7db6cec2e8" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 79.855051ms
11652025-01-02T23:33:00.078ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27297 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = d43d7ea5-8bbb-4941-b04d-72ce97f42807 response_code = 500 uri = /cockroachdb
11662025-01-02T23:33:00.078ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d43d7ea5-8bbb-4941-b04d-72ce97f42807", "content-length": "124", "date": "Thu, 02 Jan 2025 23:32:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d43d7ea5-8bbb-4941-b04d-72ce97f42807" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 175.094447ms
11672025-01-02T23:33:00.280ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 24663 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = a6eda437-c70f-4a63-a446-5ca7d5b974a9 response_code = 500 uri = /cockroachdb
11682025-01-02T23:33:00.280ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "a6eda437-c70f-4a63-a446-5ca7d5b974a9", "content-length": "124", "date": "Thu, 02 Jan 2025 23:32:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "a6eda437-c70f-4a63-a446-5ca7d5b974a9" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 120.888974ms
11692025-01-02T23:33:00.427ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = 05ae560b-f90b-4b5c-a3b9-e0ae90e5f3f6 response_code = 500 uri = /cockroachdb
11702025-01-02T23:33:00.427ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "05ae560b-f90b-4b5c-a3b9-e0ae90e5f3f6", "content-length": "124", "date": "Thu, 02 Jan 2025 23:32:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "05ae560b-f90b-4b5c-a3b9-e0ae90e5f3f6" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 107.69388ms
11712025-01-02T23:33:00.561ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25214 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = f29be338-c487-417b-8736-728102951780 response_code = 500 uri = /cockroachdb
11722025-01-02T23:33:00.561ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f29be338-c487-417b-8736-728102951780", "content-length": "124", "date": "Thu, 02 Jan 2025 23:32:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f29be338-c487-417b-8736-728102951780" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 267.181827ms
11732025-01-02T23:33:00.856ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 26627 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = 7104c355-8409-41c9-9cef-93cbd1fe4366 response_code = 500 uri = /cockroachdb
11742025-01-02T23:33:00.856ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7104c355-8409-41c9-9cef-93cbd1fe4366", "content-length": "124", "date": "Thu, 02 Jan 2025 23:32:59 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7104c355-8409-41c9-9cef-93cbd1fe4366" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 181.189597ms
11752025-01-02T23:33:01.064ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25836 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = 1cd90145-2d5e-4f81-9eaf-981fac281f7a response_code = 500 uri = /cockroachdb
11762025-01-02T23:33:01.065ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "1cd90145-2d5e-4f81-9eaf-981fac281f7a", "content-length": "124", "date": "Thu, 02 Jan 2025 23:33:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "1cd90145-2d5e-4f81-9eaf-981fac281f7a" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 281.055842ms
11772025-01-02T23:33:01.372ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 24941 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = 773c2995-a6d9-4982-9bd6-b8a9868ae0b4 response_code = 500 uri = /cockroachdb
11782025-01-02T23:33:01.372ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "773c2995-a6d9-4982-9bd6-b8a9868ae0b4", "content-length": "124", "date": "Thu, 02 Jan 2025 23:33:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "773c2995-a6d9-4982-9bd6-b8a9868ae0b4" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 309.568288ms
11792025-01-02T23:33:01.709ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 25534 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = dd7333e0-6558-407c-a313-8fddc128c244 response_code = 500 uri = /cockroachdb
11802025-01-02T23:33:01.709ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "dd7333e0-6558-407c-a313-8fddc128c244", "content-length": "124", "date": "Thu, 02 Jan 2025 23:33:01 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "dd7333e0-6558-407c-a313-8fddc128c244" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 469.550321ms
11812025-01-02T23:33:02.209ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService8/omicron6 in oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_3c72e847-3356-4d80-93ed-0a28ca2524d2 /usr/sbin/ipadm show-addr -p -o ADDR oxControlService8/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28307 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = d2d7d9d2-fe6c-437a-8ee9-36d3d0877075 response_code = 500 uri = /cockroachdb
11822025-01-02T23:33:02.209ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d2d7d9d2-fe6c-437a-8ee9-36d3d0877075", "content-length": "124", "date": "Thu, 02 Jan 2025 23:33:02 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d2d7d9d2-fe6c-437a-8ee9-36d3d0877075" } file = sled-agent/src/rack_setup/service.rs:1157 retry_after = 758.65876ms
11832025-01-02T23:33:02.999ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::7]:32221 file = sled-agent/src/services.rs:3743
11842025-01-02T23:33:11.228ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3761
11852025-01-02T23:33:15.694ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3784
11862025-01-02T23:33:15.694ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12723699 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:44491 req_id = 99cc4cc3-0d7f-4217-849d-2f4593904d4d response_code = 204 uri = /cockroachdb
11872025-01-02T23:33:15.757ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 21a27c6b-77bd-4944-8154-b74f56d79cee (service), filesystem_pool: Some(ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: edeee364-a24a-4b1f-a2f2-141a71f809d6 (service), filesystem_pool: Some(ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38 (service), filesystem_pool: Some(ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b (service), filesystem_pool: Some(ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 9e4b877c-f466-41d4-bd53-6cc6b25c439e, kind: Service { id: e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b }, name: Name("ntp-e6af6dc3-5c07-4a4e-b268-a8c0d2f30a7b"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 218, 172])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.1.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: b7d7e3fd-8645-445f-9d22-1af398592575 (service), filesystem_pool: Some(ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } } } }, OmicronZoneConfig { id: e277dedb-b1ac-4d23-a435-66ef92de00eb (service), filesystem_pool: Some(ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 5ecc1e49-3c64-4dde-9882-928207a785a6 (service), filesystem_pool: Some(ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4 (service), filesystem_pool: Some(ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3c72e847-3356-4d80-93ed-0a28ca2524d2 (service), filesystem_pool: Some(ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 (service), filesystem_pool: Some(ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.1.164:53, nic: NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 (service), filesystem_pool: Some(ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.1.165:53, nic: NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 (service), filesystem_pool: Some(ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.1.166, nic: NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 (service), filesystem_pool: Some(ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.1.167, nic: NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 56011122-5ef5-4404-a960-4d469159f36a (service), filesystem_pool: Some(ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.1.168, nic: NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: b48215cb-c824-4631-91b6-5d65088888bc (service), filesystem_pool: Some(ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: e09a28c9-f82e-4ab5-8a93-065cc9f1b974 (service), filesystem_pool: Some(ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } } } }, OmicronZoneConfig { id: cf135069-df18-4351-9e7e-1fa71b75ded5 (service), filesystem_pool: Some(ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: a07075ca-faec-4544-8dff-f18a7f9afddc (service), filesystem_pool: Some(ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 2b28e78c-726d-43a4-ae70-ca2573494176 (service), filesystem_pool: Some(ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: e63ba9de-8600-443e-8053-f7e98431ebe7 (service), filesystem_pool: Some(ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External } } } }, OmicronZoneConfig { id: 22807597-eb99-44d0-9d1a-b6c3ff0e2eb1 (service), filesystem_pool: Some(ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2582091d-373d-488a-8cc7-af0fb41774b5 (service), filesystem_pool: Some(ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 9fb60c49-fa49-4943-a237-732a1b7ac120 (service), filesystem_pool: Some(ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External } } } }, OmicronZoneConfig { id: d622c581-0328-4a2e-a21c-173d5cba1c2b (service), filesystem_pool: Some(ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1c374686-06aa-4b62-b055-e579e443a265 (service), filesystem_pool: Some(ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External } } } }, OmicronZoneConfig { id: 8bbd31ba-899d-4357-a738-0e0e4c5326b3 (service), filesystem_pool: Some(ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External } } } }, OmicronZoneConfig { id: 159dab40-9ade-4b30-8f4b-81dc5dea0bf8 (service), filesystem_pool: Some(ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External } } } }, OmicronZoneConfig { id: 22e82532-08ef-4fa8-938b-1c45f9f06660 (service), filesystem_pool: Some(ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
11882025-01-02T23:33:15.758ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35185
11892025-01-02T23:33:15.759ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 21a27c6b-77bd-4944-8154-b74f56d79cee, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11902025-01-02T23:33:15.759ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 21a27c6b-77bd-4944-8154-b74f56d79cee, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: InternalDns }, responder: ... }
11912025-01-02T23:33:15.808ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: edeee364-a24a-4b1f-a2f2-141a71f809d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11922025-01-02T23:33:15.808ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: edeee364-a24a-4b1f-a2f2-141a71f809d6, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11932025-01-02T23:33:15.849ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
11942025-01-02T23:33:15.849ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d4b90c53-96f8-4cf9-bd4e-ce25f1c17f38, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
11952025-01-02T23:33:15.894ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: b7d7e3fd-8645-445f-9d22-1af398592575, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11962025-01-02T23:33:15.894ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: b7d7e3fd-8645-445f-9d22-1af398592575, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Cockroach }, responder: ... }
11972025-01-02T23:33:15.936ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e277dedb-b1ac-4d23-a435-66ef92de00eb, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
11982025-01-02T23:33:15.936ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e277dedb-b1ac-4d23-a435-66ef92de00eb, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11992025-01-02T23:33:15.980ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 5ecc1e49-3c64-4dde-9882-928207a785a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12002025-01-02T23:33:15.980ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 5ecc1e49-3c64-4dde-9882-928207a785a6, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12012025-01-02T23:33:16.024ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12022025-01-02T23:33:16.024ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: ff42eb5d-5a38-4c67-b3c5-6dec5639ccd4, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12032025-01-02T23:33:16.072ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3c72e847-3356-4d80-93ed-0a28ca2524d2, dataset_name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:603
12042025-01-02T23:33:16.072ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3c72e847-3356-4d80-93ed-0a28ca2524d2, dataset_name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12052025-01-02T23:33:16.126ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12062025-01-02T23:33:16.126ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12072025-01-02T23:33:16.177ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: cf07b438-4026-4d20-a0d8-212a50bca0d8, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:603
12082025-01-02T23:33:16.177ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: cf07b438-4026-4d20-a0d8-212a50bca0d8, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12092025-01-02T23:33:16.225ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e09a28c9-f82e-4ab5-8a93-065cc9f1b974, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:603
12102025-01-02T23:33:16.225ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e09a28c9-f82e-4ab5-8a93-065cc9f1b974, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12112025-01-02T23:33:16.275ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: e63ba9de-8600-443e-8053-f7e98431ebe7, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12122025-01-02T23:33:16.275ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: e63ba9de-8600-443e-8053-f7e98431ebe7, dataset_name: DatasetName { pool_name: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, kind: Crucible }, responder: ... }
12132025-01-02T23:33:16.319ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 22807597-eb99-44d0-9d1a-b6c3ff0e2eb1, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12142025-01-02T23:33:16.320ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 22807597-eb99-44d0-9d1a-b6c3ff0e2eb1, dataset_name: DatasetName { pool_name: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, kind: Crucible }, responder: ... }
12152025-01-02T23:33:16.360ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 2582091d-373d-488a-8cc7-af0fb41774b5, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12162025-01-02T23:33:16.360ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 2582091d-373d-488a-8cc7-af0fb41774b5, dataset_name: DatasetName { pool_name: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, kind: Crucible }, responder: ... }
12172025-01-02T23:33:16.402ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 9fb60c49-fa49-4943-a237-732a1b7ac120, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12182025-01-02T23:33:16.402ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 9fb60c49-fa49-4943-a237-732a1b7ac120, dataset_name: DatasetName { pool_name: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, kind: Crucible }, responder: ... }
12192025-01-02T23:33:16.443ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: d622c581-0328-4a2e-a21c-173d5cba1c2b, dataset_name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12202025-01-02T23:33:16.443ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: d622c581-0328-4a2e-a21c-173d5cba1c2b, dataset_name: DatasetName { pool_name: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, kind: Crucible }, responder: ... }
12212025-01-02T23:33:16.487ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 1c374686-06aa-4b62-b055-e579e443a265, dataset_name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12222025-01-02T23:33:16.487ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 1c374686-06aa-4b62-b055-e579e443a265, dataset_name: DatasetName { pool_name: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, kind: Crucible }, responder: ... }
12232025-01-02T23:33:16.532ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 8bbd31ba-899d-4357-a738-0e0e4c5326b3, dataset_name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12242025-01-02T23:33:16.532ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 8bbd31ba-899d-4357-a738-0e0e4c5326b3, dataset_name: DatasetName { pool_name: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, kind: Crucible }, responder: ... }
12252025-01-02T23:33:16.575ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 159dab40-9ade-4b30-8f4b-81dc5dea0bf8, dataset_name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12262025-01-02T23:33:16.575ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 159dab40-9ade-4b30-8f4b-81dc5dea0bf8, dataset_name: DatasetName { pool_name: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, kind: Crucible }, responder: ... }
12272025-01-02T23:33:16.627ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: 22e82532-08ef-4fa8-938b-1c45f9f06660, dataset_name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:603
12282025-01-02T23:33:16.627ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1379 request = NewFilesystemRequest { dataset_id: 22e82532-08ef-4fa8-938b-1c45f9f06660, dataset_name: DatasetName { pool_name: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, kind: Crucible }, responder: ... }
12292025-01-02T23:33:16.678ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12302025-01-02T23:33:16.678ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
12312025-01-02T23:33:16.678ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
12322025-01-02T23:33:16.679ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12332025-01-02T23:33:16.877ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12342025-01-02T23:33:16.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12352025-01-02T23:33:16.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12362025-01-02T23:33:16.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12372025-01-02T23:33:16.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12382025-01-02T23:33:16.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12392025-01-02T23:33:16.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12402025-01-02T23:33:16.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12412025-01-02T23:33:16.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12422025-01-02T23:33:16.877ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12432025-01-02T23:33:17.072ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12442025-01-02T23:33:17.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12452025-01-02T23:33:17.074ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12462025-01-02T23:33:17.100ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12472025-01-02T23:33:17.100ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12482025-01-02T23:33:17.115ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12492025-01-02T23:33:17.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12502025-01-02T23:33:17.115ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12512025-01-02T23:33:17.127ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
12522025-01-02T23:33:17.128ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b file = illumos-utils/src/zone.rs:325
12532025-01-02T23:33:17.133ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3 file = illumos-utils/src/zone.rs:325
12542025-01-02T23:33:17.139ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8 file = illumos-utils/src/zone.rs:325
12552025-01-02T23:33:17.144ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc file = illumos-utils/src/zone.rs:325
12562025-01-02T23:33:17.149ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5 file = illumos-utils/src/zone.rs:325
12572025-01-02T23:33:17.154ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc file = illumos-utils/src/zone.rs:325
12582025-01-02T23:33:17.159ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660 file = illumos-utils/src/zone.rs:325
12592025-01-02T23:33:17.164ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1 file = illumos-utils/src/zone.rs:325
12602025-01-02T23:33:17.169ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120 file = illumos-utils/src/zone.rs:325
12612025-01-02T23:33:17.276ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b file = illumos-utils/src/zone.rs:363
12622025-01-02T23:33:17.281ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3 file = illumos-utils/src/zone.rs:363
12632025-01-02T23:33:17.286ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8 file = illumos-utils/src/zone.rs:363
12642025-01-02T23:33:17.291ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc file = illumos-utils/src/zone.rs:363
12652025-01-02T23:33:17.296ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5 file = illumos-utils/src/zone.rs:363
12662025-01-02T23:33:17.301ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc file = illumos-utils/src/zone.rs:363
12672025-01-02T23:33:17.306ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660 file = illumos-utils/src/zone.rs:363
12682025-01-02T23:33:17.311ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1 file = illumos-utils/src/zone.rs:363
12692025-01-02T23:33:17.316ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120 file = illumos-utils/src/zone.rs:363
12702025-01-02T23:33:17.322ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974 file = illumos-utils/src/zone.rs:325
12712025-01-02T23:33:17.327ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7 file = illumos-utils/src/zone.rs:325
12722025-01-02T23:33:17.332ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265 file = illumos-utils/src/zone.rs:325
12732025-01-02T23:33:17.337ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176 file = illumos-utils/src/zone.rs:325
12742025-01-02T23:33:17.343ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5 file = illumos-utils/src/zone.rs:325
12752025-01-02T23:33:17.472ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12762025-01-02T23:33:17.472ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974 file = illumos-utils/src/zone.rs:363
12772025-01-02T23:33:17.556ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7 file = illumos-utils/src/zone.rs:363
12782025-01-02T23:33:17.588ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265 file = illumos-utils/src/zone.rs:363
12792025-01-02T23:33:17.601ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176 file = illumos-utils/src/zone.rs:363
12802025-01-02T23:33:17.614ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5 file = illumos-utils/src/zone.rs:363
12812025-01-02T23:33:17.690ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12822025-01-02T23:33:17.750ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12832025-01-02T23:33:17.808ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12842025-01-02T23:33:17.869ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
12852025-01-02T23:33:17.874ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12862025-01-02T23:33:17.874ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12872025-01-02T23:33:17.931ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 148, 35]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
12882025-01-02T23:33:17.931ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
12892025-01-02T23:33:17.933ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12902025-01-02T23:33:17.933ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12912025-01-02T23:33:17.987ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 145, 204]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12922025-01-02T23:33:17.988ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12932025-01-02T23:33:17.988ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:83
12942025-01-02T23:33:17.988ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:90
12952025-01-02T23:33:17.989ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12962025-01-02T23:33:17.989ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12972025-01-02T23:33:18.045ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 207, 120]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12982025-01-02T23:33:18.045ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
12992025-01-02T23:33:18.047ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13002025-01-02T23:33:18.047ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13012025-01-02T23:33:18.101ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 229, 55]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13022025-01-02T23:33:18.101ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = nexus
13032025-01-02T23:33:18.103ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13042025-01-02T23:33:18.103ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13052025-01-02T23:33:18.158ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 208, 71]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13062025-01-02T23:33:18.158ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1263 zone_type = external_dns
13072025-01-02T23:33:18.159ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.164 file = clients/dpd-client/src/lib.rs:118
13082025-01-02T23:33:18.161ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13092025-01-02T23:33:18.208ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:83
13102025-01-02T23:33:18.208ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:90
13112025-01-02T23:33:18.208ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:83
13122025-01-02T23:33:18.208ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:90
13132025-01-02T23:33:18.209ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:83
13142025-01-02T23:33:18.209ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:90
13152025-01-02T23:33:18.209ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.168 file = clients/dpd-client/src/lib.rs:118
13162025-01-02T23:33:18.212ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13172025-01-02T23:33:18.212ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.166 file = clients/dpd-client/src/lib.rs:118
13182025-01-02T23:33:18.216ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.167 file = clients/dpd-client/src/lib.rs:118
13192025-01-02T23:33:18.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13202025-01-02T23:33:18.219ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13212025-01-02T23:33:18.219ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:83
13222025-01-02T23:33:18.219ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:90
13232025-01-02T23:33:18.277ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242 file = illumos-utils/src/zone.rs:325
13242025-01-02T23:33:18.403ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.1.165 file = clients/dpd-client/src/lib.rs:118
13252025-01-02T23:33:18.407ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a file = illumos-utils/src/zone.rs:325
13262025-01-02T23:33:18.419ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
13272025-01-02T23:33:18.420ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242 file = illumos-utils/src/zone.rs:363
13282025-01-02T23:33:18.430ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 file = illumos-utils/src/zone.rs:325
13292025-01-02T23:33:18.440ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0 file = illumos-utils/src/zone.rs:325
13302025-01-02T23:33:18.492ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a file = illumos-utils/src/zone.rs:363
13312025-01-02T23:33:18.501ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 file = illumos-utils/src/zone.rs:363
13322025-01-02T23:33:18.511ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0 file = illumos-utils/src/zone.rs:363
13332025-01-02T23:33:18.523ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8 file = illumos-utils/src/zone.rs:325
13342025-01-02T23:33:18.564ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8 file = illumos-utils/src/zone.rs:363
13352025-01-02T23:33:27.390ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13362025-01-02T23:33:27.407ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
13372025-01-02T23:33:27.410ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13382025-01-02T23:33:27.416ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
13392025-01-02T23:33:29.100ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59119
13402025-01-02T23:33:29.213ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 428 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:59119 req_id = 8cddb91d-42b3-4b6d-a445-ed76c182bde5 response_code = 200 uri = /baseboard
13412025-01-02T23:33:29.490ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bd42dc62-762a-4947-84e6-57025e292015/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='04230b96-82b1-4166-b764-48317456e4a5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422025-01-02T23:33:29.490ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b381834f-f025-41b4-b6f7-d83e636b0767'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13432025-01-02T23:33:29.491ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='c08c7e2a-b387-4890-8a47-a6a41c191200'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13442025-01-02T23:33:29.491ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_3422f079-8bbb-4453-89ec-a156fe56575a/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='82e90c1c-a9f0-4ae7-8298-163f43902fde'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13452025-01-02T23:33:29.491ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_761fec61-ade0-4579-af52-842b38e6e3a3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='339e8597-53b6-4855-912c-139fec7a5977'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13462025-01-02T23:33:29.492ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='1f1deb45-0ee1-4313-bafc-430dead2a710'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13472025-01-02T23:33:29.492ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
13482025-01-02T23:33:29.500ZINFOSledAgent (ServiceManager): Booting oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
13492025-01-02T23:33:29.506ZINFOSledAgent (ServiceManager): Booting oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
13502025-01-02T23:33:29.511ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
13512025-01-02T23:33:29.517ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
13522025-01-02T23:33:29.524ZINFOSledAgent (ServiceManager): Booting oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
13532025-01-02T23:33:29.546ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='70cb8b5b-64fd-4a50-8eae-51d730177378'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13542025-01-02T23:33:29.590ZINFOSledAgent (ServiceManager): Booting oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
13552025-01-02T23:33:30.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 31.261494ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
13562025-01-02T23:33:30.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 72.732614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
13572025-01-02T23:33:30.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 32.135361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
13582025-01-02T23:33:30.105ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 37.024553ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
13592025-01-02T23:33:30.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 30.046041ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
13602025-01-02T23:33:30.124ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 58.401491ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
13612025-01-02T23:33:30.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 73.778343ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
13622025-01-02T23:33:30.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 35.629453ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
13632025-01-02T23:33:30.150ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 78.019273ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
13642025-01-02T23:33:30.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 106.909203ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
13652025-01-02T23:33:30.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 48.688387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
13662025-01-02T23:33:30.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 100.721258ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
13672025-01-02T23:33:30.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 107.914189ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
13682025-01-02T23:33:30.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 111.643533ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
13692025-01-02T23:33:30.208ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 92.66936ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
13702025-01-02T23:33:30.250ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 80.001387ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
13712025-01-02T23:33:30.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 138.886886ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
13722025-01-02T23:33:30.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 115.784414ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
13732025-01-02T23:33:30.279ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 72.470184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
13742025-01-02T23:33:30.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 267.806199ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
13752025-01-02T23:33:30.298ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 151.0358ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
13762025-01-02T23:33:30.308ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 128.579277ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
13772025-01-02T23:33:30.320ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 101.17984ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
13782025-01-02T23:33:30.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 124.372881ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
13792025-01-02T23:33:30.347ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 178.78698ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
13802025-01-02T23:33:30.361ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 258.780909ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
13812025-01-02T23:33:30.362ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='b48215cb-c824-4631-91b6-5d65088888bc'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13822025-01-02T23:33:30.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 553.210907ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
13832025-01-02T23:33:30.559ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 366.752272ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
13842025-01-02T23:33:30.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 374.288444ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
13852025-01-02T23:33:30.569ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
13862025-01-02T23:33:30.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 243.760485ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
13872025-01-02T23:33:30.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 240.356404ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
13882025-01-02T23:33:30.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 211.953719ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
13892025-01-02T23:33:30.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 591.068665ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
13902025-01-02T23:33:30.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 210.851696ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
13912025-01-02T23:33:30.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 201.998013ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
13922025-01-02T23:33:30.908ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 50.378266419s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
13932025-01-02T23:33:30.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 26.145764ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
13942025-01-02T23:33:30.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 549.344767ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
13952025-01-02T23:33:30.939ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 752.805931ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
13962025-01-02T23:33:30.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.072976807s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
13972025-01-02T23:33:30.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 1.044895114s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
13982025-01-02T23:33:30.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 466.430905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
13992025-01-02T23:33:30.984ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 745.252905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
14002025-01-02T23:33:30.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.102108375s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
14012025-01-02T23:33:31.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 56.346484ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
14022025-01-02T23:33:31.071ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 177.74387ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
14032025-01-02T23:33:31.113ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 765.443429ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
14042025-01-02T23:33:31.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 724.701836ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
14052025-01-02T23:33:31.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 456.539493ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
14062025-01-02T23:33:31.454ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 718.181752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
14072025-01-02T23:33:31.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 1.196785797s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
14082025-01-02T23:33:31.706ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 1.162462277s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
14092025-01-02T23:33:31.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 1.002702895s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
14102025-01-02T23:33:31.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 575.545835ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
14112025-01-02T23:33:31.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 743.957657ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
14122025-01-02T23:33:31.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.227157334s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
14132025-01-02T23:33:31.979ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14142025-01-02T23:33:31.979ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14152025-01-02T23:33:31.998ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14162025-01-02T23:33:32.011ZINFOSledAgent (ServiceManager): Booting oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14172025-01-02T23:33:32.017ZINFOSledAgent (ServiceManager): Booting oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
14182025-01-02T23:33:32.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 755.406737ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
14192025-01-02T23:33:32.034ZINFOSledAgent (ServiceManager): Booting oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
14202025-01-02T23:33:32.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 751.799081ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
14212025-01-02T23:33:32.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.202023058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
14222025-01-02T23:33:32.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 1.298528049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
14232025-01-02T23:33:32.220ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 60.514086ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14242025-01-02T23:33:32.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 54.986759ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
14252025-01-02T23:33:32.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 28.21925ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
14262025-01-02T23:33:32.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 96.995295ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
14272025-01-02T23:33:32.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 69.423066ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14282025-01-02T23:33:32.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 99.028452ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
14292025-01-02T23:33:32.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 974.278386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
14302025-01-02T23:33:32.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 295.796197ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14312025-01-02T23:33:32.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 239.588062ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
14322025-01-02T23:33:32.415ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 262.855799ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
14332025-01-02T23:33:32.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 536.67323ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
14342025-01-02T23:33:32.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 1.497430699s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
14352025-01-02T23:33:32.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 224.701022ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14362025-01-02T23:33:32.698ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 249.533113ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
14372025-01-02T23:33:32.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 1.222974031s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
14382025-01-02T23:33:32.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 1.166234183s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
14392025-01-02T23:33:32.802ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 589.254847ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
14402025-01-02T23:33:32.813ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 822.338018ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
14412025-01-02T23:33:32.882ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 870.279467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
14422025-01-02T23:33:32.923ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 604.51747ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14432025-01-02T23:33:32.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 666.81384ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
14442025-01-02T23:33:33.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 883.502787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
14452025-01-02T23:33:33.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 772.093006ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
14462025-01-02T23:33:33.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 811.867883ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
14472025-01-02T23:33:33.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.389813556s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
14482025-01-02T23:33:33.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 620.093784ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
14492025-01-02T23:33:33.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 1.353285614s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
14502025-01-02T23:33:33.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 755.541809ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14512025-01-02T23:33:33.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 804.049018ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
14522025-01-02T23:33:33.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.175973155s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
14532025-01-02T23:33:33.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 1.353370503s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
14542025-01-02T23:33:33.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 1.359495027s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
14552025-01-02T23:33:33.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 732.548871ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
14562025-01-02T23:33:33.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 1.229839404s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
14572025-01-02T23:33:34.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 696.912787ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
14582025-01-02T23:33:34.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.155041061s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
14592025-01-02T23:33:34.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 1.061713652s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
14602025-01-02T23:33:34.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 908.938182ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
14612025-01-02T23:33:34.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 554.351436ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14622025-01-02T23:33:34.473ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 1.358915378s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
14632025-01-02T23:33:34.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 795.96426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
14642025-01-02T23:33:34.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.090881038s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
14652025-01-02T23:33:34.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 1.397376304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
14662025-01-02T23:33:35.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 508.446885ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
14672025-01-02T23:33:35.181ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 1.080849729s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
14682025-01-02T23:33:35.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 585.254642ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
14692025-01-02T23:33:35.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 719.010395ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14702025-01-02T23:33:35.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 591.591418ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
14712025-01-02T23:33:35.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 1.334142402s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
14722025-01-02T23:33:35.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 541.151352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
14732025-01-02T23:33:35.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 574.236801ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
14742025-01-02T23:33:35.276ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14752025-01-02T23:33:35.276ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
14762025-01-02T23:33:35.293ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 696.900838ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
14772025-01-02T23:33:35.412ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='0626b04f-5962-4058-8649-a69866cc6069'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14782025-01-02T23:33:35.412ZINFOSledAgent (ServiceManager): Booting oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
14792025-01-02T23:33:35.436ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9c569eb8-99da-4c39-9e12-41759dba24d6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='eb1e111b-ea41-40b8-966a-523e0402db98'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14802025-01-02T23:33:35.437ZINFOSledAgent (ServiceManager): Booting oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
14812025-01-02T23:33:35.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 704.603528ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
14822025-01-02T23:33:35.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 26.58813ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
14832025-01-02T23:33:35.567ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 149.795332ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
14842025-01-02T23:33:35.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.041171255s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
14852025-01-02T23:33:35.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 70.652102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
14862025-01-02T23:33:35.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 40.141474ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
14872025-01-02T23:33:35.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 250.11304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
14882025-01-02T23:33:35.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 79.987037ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
14892025-01-02T23:33:35.784ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 115.88961ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
14902025-01-02T23:33:35.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 769.316065ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
14912025-01-02T23:33:35.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 918.683711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
14922025-01-02T23:33:35.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.160597942s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
14932025-01-02T23:33:35.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 712.747066ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
14942025-01-02T23:33:35.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 613.036234ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
14952025-01-02T23:33:35.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.096350508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
14962025-01-02T23:33:35.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 198.079623ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
14972025-01-02T23:33:35.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 167.962146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
14982025-01-02T23:33:35.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 1.452946599s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
14992025-01-02T23:33:35.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 323.597028ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
15002025-01-02T23:33:36.002ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 886.740622ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
15012025-01-02T23:33:36.085ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 290.861452ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
15022025-01-02T23:33:36.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 405.435549ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
15032025-01-02T23:33:36.169ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 1.37141763s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
15042025-01-02T23:33:36.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 781.466312ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
15052025-01-02T23:33:36.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 518.598806ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
15062025-01-02T23:33:36.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 914.977003ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
15072025-01-02T23:33:36.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 683.025309ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
15082025-01-02T23:33:36.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 995.592278ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
15092025-01-02T23:33:36.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 601.568415ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
15102025-01-02T23:33:36.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 858.487059ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
15112025-01-02T23:33:36.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 698.817503ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
15122025-01-02T23:33:36.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 1.144882674s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
15132025-01-02T23:33:36.601ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15142025-01-02T23:33:36.602ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15152025-01-02T23:33:36.631ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15162025-01-02T23:33:36.639ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
15172025-01-02T23:33:36.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.003991469s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
15182025-01-02T23:33:36.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 665.728058ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
15192025-01-02T23:33:36.800ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 74.693698ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15202025-01-02T23:33:36.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 1.231392473s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
15212025-01-02T23:33:36.853ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 72.54718ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
15222025-01-02T23:33:36.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 61.41691ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15232025-01-02T23:33:36.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 990.915107ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
15242025-01-02T23:33:36.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 139.611315ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
15252025-01-02T23:33:36.954ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 201.974922ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15262025-01-02T23:33:36.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.286102817s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
15272025-01-02T23:33:37.003ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 753.991966ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
15282025-01-02T23:33:37.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.161006427s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
15292025-01-02T23:33:37.078ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 1.284885474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
15302025-01-02T23:33:37.087ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 116.54895ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
15312025-01-02T23:33:37.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 1.173894689s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
15322025-01-02T23:33:37.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 237.036435ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15332025-01-02T23:33:37.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 263.915181ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
15342025-01-02T23:33:37.251ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 1.395343766s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
15352025-01-02T23:33:37.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 544.092541ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
15362025-01-02T23:33:37.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 697.445895ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15372025-01-02T23:33:37.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 1.140783375s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
15382025-01-02T23:33:37.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 1.304924889s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
15392025-01-02T23:33:37.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 793.430631ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
15402025-01-02T23:33:37.483ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 1.096827401s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
15412025-01-02T23:33:37.491ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 572.389923ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
15422025-01-02T23:33:37.549ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 611.570944ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
15432025-01-02T23:33:37.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.122136473s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
15442025-01-02T23:33:37.756ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 668.898819ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
15452025-01-02T23:33:37.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 1.113222372s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
15462025-01-02T23:33:37.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 711.680337ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
15472025-01-02T23:33:37.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 1.1234465s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
15482025-01-02T23:33:38.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 1.315804945s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
15492025-01-02T23:33:38.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 1.203026908s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
15502025-01-02T23:33:38.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 828.351675ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15512025-01-02T23:33:38.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 1.021021665s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
15522025-01-02T23:33:38.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 998.15734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
15532025-01-02T23:33:38.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 1.478165594s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
15542025-01-02T23:33:38.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.411956475s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
15552025-01-02T23:33:38.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 639.406006ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
15562025-01-02T23:33:38.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 658.05386ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
15572025-01-02T23:33:38.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 971.800141ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
15582025-01-02T23:33:38.573ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 1.373726143s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
15592025-01-02T23:33:38.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 691.184604ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
15602025-01-02T23:33:38.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 1.226704383s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
15612025-01-02T23:33:38.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 875.44164ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
15622025-01-02T23:33:38.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 680.220814ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
15632025-01-02T23:33:38.850ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 745.704078ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
15642025-01-02T23:33:38.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 574.167346ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
15652025-01-02T23:33:38.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 1.385270354s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
15662025-01-02T23:33:38.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 541.50165ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15672025-01-02T23:33:39.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 1.169090534s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
15682025-01-02T23:33:39.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 1.221444052s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
15692025-01-02T23:33:39.195ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 960.826658ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
15702025-01-02T23:33:39.205ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 817.986492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
15712025-01-02T23:33:39.283ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 605.878718ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
15722025-01-02T23:33:39.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 802.605635ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
15732025-01-02T23:33:39.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 1.176918911s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
15742025-01-02T23:33:39.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 625.411034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
15752025-01-02T23:33:39.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 1.077220091s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
15762025-01-02T23:33:39.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 1.471859648s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
15772025-01-02T23:33:39.517ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 805.015648ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15782025-01-02T23:33:39.541ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 603.558796ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
15792025-01-02T23:33:39.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.009209018s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
15802025-01-02T23:33:39.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.367638759s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
15812025-01-02T23:33:39.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 1.158480878s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
15822025-01-02T23:33:39.829ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 800.818552ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
15832025-01-02T23:33:39.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 700.549591ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
15842025-01-02T23:33:39.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 1.42504955s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
15852025-01-02T23:33:40.033ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 887.542724ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
15862025-01-02T23:33:40.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 556.041266ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
15872025-01-02T23:33:40.109ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 1.03526713s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
15882025-01-02T23:33:40.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 1.370151397s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
15892025-01-02T23:33:40.167ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 582.218725ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
15902025-01-02T23:33:40.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 1.127675449s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
15912025-01-02T23:33:40.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 979.542325ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
15922025-01-02T23:33:40.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 1.313289725s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
15932025-01-02T23:33:40.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 990.919797ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
15942025-01-02T23:33:40.524ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 738.936982ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
15952025-01-02T23:33:40.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 1.455879971s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
15962025-01-02T23:33:40.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 1.272706502s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
15972025-01-02T23:33:40.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 1.336285474s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
15982025-01-02T23:33:40.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.410060716s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
15992025-01-02T23:33:40.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 839.342225ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
16002025-01-02T23:33:40.765ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.209981291s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
16012025-01-02T23:33:40.907ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 1.060099876s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
16022025-01-02T23:33:40.935ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 1.495124564s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
16032025-01-02T23:33:40.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 781.706285ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
16042025-01-02T23:33:41.035ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:8123'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
16052025-01-02T23:33:41.035ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16062025-01-02T23:33:41.074ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.044900388s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
16072025-01-02T23:33:41.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 783.35718ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
16082025-01-02T23:33:41.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 1.405916056s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
16092025-01-02T23:33:41.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 1.027786883s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
16102025-01-02T23:33:41.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 42.483731ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16112025-01-02T23:33:41.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 149.007583ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16122025-01-02T23:33:41.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 1.305259439s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
16132025-01-02T23:33:41.373ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 791.983436ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
16142025-01-02T23:33:41.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 1.28428145s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
16152025-01-02T23:33:41.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 985.989915ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
16162025-01-02T23:33:41.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 135.648047ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16172025-01-02T23:33:41.644ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 1.278997222s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
16182025-01-02T23:33:41.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 1.158110742s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
16192025-01-02T23:33:41.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 596.081528ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16202025-01-02T23:33:41.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 967.725289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
16212025-01-02T23:33:41.898ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 1.415664317s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
16222025-01-02T23:33:41.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 570.541824ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
16232025-01-02T23:33:41.970ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 1.342010939s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
16242025-01-02T23:33:41.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 1.387942235s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
16252025-01-02T23:33:41.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 645.519276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
16262025-01-02T23:33:42.045ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 1.030466329s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
16272025-01-02T23:33:42.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 973.49284ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
16282025-01-02T23:33:42.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.088817997s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
16292025-01-02T23:33:42.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 1.492561915s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
16302025-01-02T23:33:42.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 640.249419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
16312025-01-02T23:33:42.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 586.533154ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16322025-01-02T23:33:42.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 974.171052ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
16332025-01-02T23:33:42.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 1.060768166s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
16342025-01-02T23:33:42.538ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 650.727458ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
16352025-01-02T23:33:42.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.391604733s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
16362025-01-02T23:33:42.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 861.717531ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
16372025-01-02T23:33:42.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 886.191638ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
16382025-01-02T23:33:42.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 630.916901ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
16392025-01-02T23:33:42.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 844.330507ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
16402025-01-02T23:33:42.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 1.199742265s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
16412025-01-02T23:33:42.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 1.268661463s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
16422025-01-02T23:33:42.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 770.200975ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16432025-01-02T23:33:42.979ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 879.782178ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
16442025-01-02T23:33:43.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.460630367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
16452025-01-02T23:33:43.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 989.456892ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
16462025-01-02T23:33:43.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 1.368545174s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
16472025-01-02T23:33:43.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.187909632s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
16482025-01-02T23:33:43.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 780.141377ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
16492025-01-02T23:33:43.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 1.179310231s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
16502025-01-02T23:33:43.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 1.486264359s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
16512025-01-02T23:33:43.388ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 1.314739055s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
16522025-01-02T23:33:43.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 1.412254335s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
16532025-01-02T23:33:43.556ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 656.791435ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
16542025-01-02T23:33:43.580ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 830.388613ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
16552025-01-02T23:33:43.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 1.282913642s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
16562025-01-02T23:33:43.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 822.699081ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
16572025-01-02T23:33:43.688ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 877.596311ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
16582025-01-02T23:33:43.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 806.747493ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16592025-01-02T23:33:43.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 1.008987485s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
16602025-01-02T23:33:44.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.246182563s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
16612025-01-02T23:33:44.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 1.176412192s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
16622025-01-02T23:33:44.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 1.022484955s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
16632025-01-02T23:33:44.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 1.240480362s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
16642025-01-02T23:33:44.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 811.926035ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
16652025-01-02T23:33:44.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 1.10798956s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
16662025-01-02T23:33:44.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 1.009887423s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
16672025-01-02T23:33:44.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 598.234752ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
16682025-01-02T23:33:44.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 1.332314979s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
16692025-01-02T23:33:44.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.391514244s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
16702025-01-02T23:33:44.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 538.061274ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
16712025-01-02T23:33:44.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 1.438630352s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16722025-01-02T23:33:44.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 1.361558424s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
16732025-01-02T23:33:44.599ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 1.020427475s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
16742025-01-02T23:33:44.731ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 709.263802ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
16752025-01-02T23:33:44.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 517.096205ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
16762025-01-02T23:33:44.874ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 968.939352ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
16772025-01-02T23:33:44.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 770.33606ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
16782025-01-02T23:33:44.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 1.348305481s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
16792025-01-02T23:33:45.057ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 904.726025ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
16802025-01-02T23:33:45.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.366022935s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
16812025-01-02T23:33:45.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 1.198319123s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
16822025-01-02T23:33:45.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 1.498634204s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
16832025-01-02T23:33:45.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 966.219554ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
16842025-01-02T23:33:45.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.276806545s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
16852025-01-02T23:33:45.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 781.377611ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
16862025-01-02T23:33:45.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 1.415489333s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
16872025-01-02T23:33:45.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 1.185896034s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
16882025-01-02T23:33:45.453ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 1.070291004s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
16892025-01-02T23:33:45.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 1.476039312s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
16902025-01-02T23:33:45.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 1.360327611s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
16912025-01-02T23:33:45.678ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 1.163601726s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
16922025-01-02T23:33:45.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 1.293966562s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
16932025-01-02T23:33:45.860ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 1.198925045s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
16942025-01-02T23:33:45.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.089801254s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
16952025-01-02T23:33:45.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 1.482514028s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
16962025-01-02T23:33:45.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 868.335449ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
16972025-01-02T23:33:46.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 647.405838ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
16982025-01-02T23:33:46.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 566.609914ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
16992025-01-02T23:33:46.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 1.233541362s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
17002025-01-02T23:33:46.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 619.128285ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
17012025-01-02T23:33:46.303ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 536.44946ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
17022025-01-02T23:33:46.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.313670614s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
17032025-01-02T23:33:46.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 1.498269195s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
17042025-01-02T23:33:46.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 529.082349ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
17052025-01-02T23:33:46.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 553.343102ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
17062025-01-02T23:33:46.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 513.891656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
17072025-01-02T23:33:46.679ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 810.746255ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
17082025-01-02T23:33:46.740ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 511.901915ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
17092025-01-02T23:33:46.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 670.540113ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
17102025-01-02T23:33:46.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 656.170188ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
17112025-01-02T23:33:46.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 669.545689ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
17122025-01-02T23:33:46.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 1.451856171s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
17132025-01-02T23:33:46.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 667.573243ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
17142025-01-02T23:33:46.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 907.444739ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
17152025-01-02T23:33:47.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 630.058252ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
17162025-01-02T23:33:47.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.268442702s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
17172025-01-02T23:33:47.070ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 707.044364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
17182025-01-02T23:33:47.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 922.960231ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
17192025-01-02T23:33:47.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 1.196428755s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
17202025-01-02T23:33:47.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 1.284679645s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
17212025-01-02T23:33:47.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 878.139361ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
17222025-01-02T23:33:47.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 657.396216ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
17232025-01-02T23:33:47.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 1.065483922s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
17242025-01-02T23:33:47.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5") failed: Property not found. retry in 1.308042549s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
17252025-01-02T23:33:47.502ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 1.396418782s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
17262025-01-02T23:33:47.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3") failed: Property not found. retry in 1.432386663s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
17272025-01-02T23:33:47.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 953.907513ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
17282025-01-02T23:33:47.543ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 1.030261456s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
17292025-01-02T23:33:47.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 719.924072ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
17302025-01-02T23:33:47.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242") failed: Property not found. retry in 1.169558526s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
17312025-01-02T23:33:47.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5") failed: Property not found. retry in 1.388992505s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
17322025-01-02T23:33:47.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc") failed: Property not found. retry in 1.210592937s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
17332025-01-02T23:33:47.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a") failed: Property not found. retry in 1.119626248s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
17342025-01-02T23:33:47.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc") failed: Property not found. retry in 1.425851405s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
17352025-01-02T23:33:48.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0") failed: Property not found. retry in 1.09136869s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
17362025-01-02T23:33:48.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846") failed: Property not found. retry in 1.099972981s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
17372025-01-02T23:33:48.067ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b") failed: Property not found. retry in 927.065305ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
17382025-01-02T23:33:48.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120") failed: Property not found. retry in 1.45465656s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
17392025-01-02T23:33:48.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8") failed: Property not found. retry in 730.153419ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
17402025-01-02T23:33:48.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176") failed: Property not found. retry in 611.3414ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
17412025-01-02T23:33:48.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265") failed: Property not found. retry in 1.440221035s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
17422025-01-02T23:33:48.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8") failed: Property not found. retry in 887.590986ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
17432025-01-02T23:33:48.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660") failed: Property not found. retry in 1.09455316s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
17442025-01-02T23:33:48.525ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7") failed: Property not found. retry in 1.473299779s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
17452025-01-02T23:33:48.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1") failed: Property not found. retry in 823.71472ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
17462025-01-02T23:33:48.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 618.102215ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
17472025-01-02T23:33:49.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 930.551454ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
17482025-01-02T23:33:50.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974") failed: Property not found. retry in 1.38123228s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
17492025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_d622c581-0328-4a2e-a21c-173d5cba1c2b
17502025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_8bbd31ba-899d-4357-a738-0e0e4c5326b3
17512025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_159dab40-9ade-4b30-8f4b-81dc5dea0bf8
17522025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_oximeter_b48215cb-c824-4631-91b6-5d65088888bc
17532025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_cf135069-df18-4351-9e7e-1fa71b75ded5
17542025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_a07075ca-faec-4544-8dff-f18a7f9afddc
17552025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_22e82532-08ef-4fa8-938b-1c45f9f06660
17562025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_22807597-eb99-44d0-9d1a-b6c3ff0e2eb1
17572025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_9fb60c49-fa49-4943-a237-732a1b7ac120
17582025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_3cf11230-2b59-4cce-bb9f-d43f7cd85242
17592025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_clickhouse_e09a28c9-f82e-4ab5-8a93-065cc9f1b974
17602025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846
17612025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_a65090c3-871f-4183-bf79-7d6e2eff40c0
17622025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_e63ba9de-8600-443e-8053-f7e98431ebe7
17632025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_external_dns_cf07b438-4026-4d20-a0d8-212a50bca0d8
17642025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_1c374686-06aa-4b62-b055-e579e443a265
17652025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_pantry_2b28e78c-726d-43a4-ae70-ca2573494176
17662025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_nexus_56011122-5ef5-4404-a960-4d469159f36a
17672025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3310 zone = oxz_crucible_2582091d-373d-488a-8cc7-af0fb41774b5
17682025-01-02T23:33:52.002ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17692025-01-02T23:33:52.005ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
17702025-01-02T23:33:52.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36255807 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:35185 req_id = ea7bb87e-ca5e-4996-91ca-8eeec54f9418 response_code = 204 uri = /omicron-zones
17712025-01-02T23:33:52.020ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
17722025-01-02T23:33:52.272ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
17732025-01-02T23:33:52.275ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:802
17742025-01-02T23:33:52.338ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.1.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1016
17752025-01-02T23:33:52.696ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17762025-01-02T23:33:52.786ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17772025-01-02T23:33:52.957ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17782025-01-02T23:33:52.994ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
17792025-01-02T23:33:52.996ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/nexus.rs:527 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
17802025-01-02T23:33:53.041ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17812025-01-02T23:33:53.162ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17822025-01-02T23:33:53.447ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17832025-01-02T23:33:53.619ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/nexus.rs:527 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
17842025-01-02T23:33:53.697ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17852025-01-02T23:33:53.881ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17862025-01-02T23:33:53.997ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
17872025-01-02T23:33:54.175ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17882025-01-02T23:33:54.562ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17892025-01-02T23:33:55.000ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
17902025-01-02T23:33:55.111ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17912025-01-02T23:33:55.618ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/nexus.rs:527 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
17922025-01-02T23:33:55.782ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17932025-01-02T23:33:56.001ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
17942025-01-02T23:33:56.575ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17952025-01-02T23:33:57.004ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/probe_manager.rs:231 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
17962025-01-02T23:33:57.617ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/8a1161d7-6d62-4983-bc09-f43d060ae472) file = sled-agent/src/nexus.rs:527 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
17972025-01-02T23:33:57.780ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/14faf6b0-5f4e-4732-8d82-c8856196086a/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1078
17982025-01-02T23:33:59.337ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46166
17992025-01-02T23:33:59.337ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:46166 req_id = e8109ba9-649a-4571-bcb1-5e045d42492b response_code = 200 uri = /baseboard
18002025-01-02T23:34:00.960ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4f8b175a-52b3-461b-bed3-b9b4fb31919e", "content-length": "173", "date": "Thu, 02 Jan 2025 23:34:00 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"14faf6b0-5f4e-4732-8d82-c8856196086a\"", request_id: "4f8b175a-52b3-461b-bed3-b9b4fb31919e" } file = sled-agent/src/rack_setup/service.rs:1078
18012025-01-02T23:34:02.158ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b9b05f77-3009-4786-b8ec-25e294c6f27d", "content-length": "173", "date": "Thu, 02 Jan 2025 23:34:02 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"14faf6b0-5f4e-4732-8d82-c8856196086a\"", request_id: "b9b05f77-3009-4786-b8ec-25e294c6f27d" } file = sled-agent/src/rack_setup/service.rs:1078
18022025-01-02T23:34:02.337ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
18032025-01-02T23:34:04.385ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "25e5c321-6de6-4aef-8a7f-af6e40caf338", "content-length": "173", "date": "Thu, 02 Jan 2025 23:34:04 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"14faf6b0-5f4e-4732-8d82-c8856196086a\"", request_id: "25e5c321-6de6-4aef-8a7f-af6e40caf338" } file = sled-agent/src/rack_setup/service.rs:1078
18042025-01-02T23:34:04.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48485
18052025-01-02T23:34:04.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2040 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48485 req_id = 6d5dcdfe-6089-4eb7-95c6-3c2542916192 response_code = 200 uri = /vpc-routes
18062025-01-02T23:34:04.995ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36086
18072025-01-02T23:34:05.016ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18082025-01-02T23:34:05.016ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18092025-01-02T23:34:05.017ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
18102025-01-02T23:34:05.017ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
18112025-01-02T23:34:05.030ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18122025-01-02T23:34:05.030ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e
18132025-01-02T23:34:05.055ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18142025-01-02T23:34:05.055ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9c569eb8-99da-4c39-9e12-41759dba24d6
18152025-01-02T23:34:05.075ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18162025-01-02T23:34:05.075ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_761fec61-ade0-4579-af52-842b38e6e3a3
18172025-01-02T23:34:05.102ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18182025-01-02T23:34:05.102ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24
18192025-01-02T23:34:05.115ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
18202025-01-02T23:34:05.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1861 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48485 req_id = 4cffc4dc-bbc9-458b-bd04-2c07510d21f8 response_code = 204 uri = /eip-gateways
18212025-01-02T23:34:05.127ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18222025-01-02T23:34:05.127ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5
18232025-01-02T23:34:05.150ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18242025-01-02T23:34:05.150ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3422f079-8bbb-4453-89ec-a156fe56575a
18252025-01-02T23:34:05.174ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18262025-01-02T23:34:05.174ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd42dc62-762a-4947-84e6-57025e292015
18272025-01-02T23:34:05.196ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18282025-01-02T23:34:05.196ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d
18292025-01-02T23:34:05.218ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18302025-01-02T23:34:05.218ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6
18312025-01-02T23:34:05.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 229781 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36086 req_id = ac8ff251-9a39-4057-b4fb-25a4befc3b59 response_code = 200 uri = /inventory
18322025-01-02T23:34:05.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37860
18332025-01-02T23:34:05.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5196 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37860 req_id = c1fc972d-5814-43b1-923e-66323d08f2ce response_code = 200 uri = /v2p
18342025-01-02T23:34:05.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1554 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48485 req_id = 73fc5a72-2bb6-441b-bef3-2779268d3cf2 response_code = 204 uri = /vpc-routes
18352025-01-02T23:34:06.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63576
18362025-01-02T23:34:06.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18372025-01-02T23:34:06.194ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18382025-01-02T23:34:06.194ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
18392025-01-02T23:34:06.194ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
18402025-01-02T23:34:06.206ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18412025-01-02T23:34:06.206ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e
18422025-01-02T23:34:06.232ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18432025-01-02T23:34:06.232ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9c569eb8-99da-4c39-9e12-41759dba24d6
18442025-01-02T23:34:06.257ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18452025-01-02T23:34:06.257ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_761fec61-ade0-4579-af52-842b38e6e3a3
18462025-01-02T23:34:06.281ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18472025-01-02T23:34:06.281ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24
18482025-01-02T23:34:06.303ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18492025-01-02T23:34:06.303ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5
18502025-01-02T23:34:06.325ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18512025-01-02T23:34:06.325ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3422f079-8bbb-4453-89ec-a156fe56575a
18522025-01-02T23:34:06.347ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18532025-01-02T23:34:06.347ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd42dc62-762a-4947-84e6-57025e292015
18542025-01-02T23:34:06.370ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18552025-01-02T23:34:06.370ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d
18562025-01-02T23:34:06.394ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18572025-01-02T23:34:06.394ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6
18582025-01-02T23:34:06.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 213418 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63576 req_id = 2dd2e64e-e261-4ecf-830a-6771f75607e6 response_code = 200 uri = /inventory
18592025-01-02T23:34:06.757ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54798
18602025-01-02T23:34:06.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54798 req_id = fa1691b4-0cc0-461d-a412-b29fb41fd92b response_code = 200 uri = /vpc-routes
18612025-01-02T23:34:06.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60254
18622025-01-02T23:34:06.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18632025-01-02T23:34:06.914ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18642025-01-02T23:34:06.914ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
18652025-01-02T23:34:06.924ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
18662025-01-02T23:34:06.936ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18672025-01-02T23:34:06.936ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e
18682025-01-02T23:34:06.969ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18692025-01-02T23:34:06.969ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9c569eb8-99da-4c39-9e12-41759dba24d6
18702025-01-02T23:34:07.001ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18712025-01-02T23:34:07.001ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_761fec61-ade0-4579-af52-842b38e6e3a3
18722025-01-02T23:34:07.033ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18732025-01-02T23:34:07.033ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24
18742025-01-02T23:34:07.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46031
18752025-01-02T23:34:07.056ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46031 req_id = 1f47f112-bf22-49b1-9bce-c4c088294910 response_code = 200 uri = /vpc-routes
18762025-01-02T23:34:07.063ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18772025-01-02T23:34:07.063ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5
18782025-01-02T23:34:07.077ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35509
18792025-01-02T23:34:07.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35509 req_id = 69bc5085-eabb-4623-951f-670372c2ff04 response_code = 200 uri = /v2p
18802025-01-02T23:34:07.091ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18812025-01-02T23:34:07.091ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3422f079-8bbb-4453-89ec-a156fe56575a
18822025-01-02T23:34:07.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
18832025-01-02T23:34:07.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54798 req_id = 6fe96dc9-fb17-4eb3-8934-8669e80b8074 response_code = 204 uri = /eip-gateways
18842025-01-02T23:34:07.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
18852025-01-02T23:34:07.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46031 req_id = 2ba95f3c-026a-400f-bf26-e88f747a115f response_code = 204 uri = /eip-gateways
18862025-01-02T23:34:07.118ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18872025-01-02T23:34:07.118ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd42dc62-762a-4947-84e6-57025e292015
18882025-01-02T23:34:07.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44325
18892025-01-02T23:34:07.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18902025-01-02T23:34:07.133ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
18912025-01-02T23:34:07.134ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
18922025-01-02T23:34:07.140ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
18932025-01-02T23:34:07.149ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18942025-01-02T23:34:07.149ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d
18952025-01-02T23:34:07.165ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18962025-01-02T23:34:07.165ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e
18972025-01-02T23:34:07.194ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
18982025-01-02T23:34:07.194ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9c569eb8-99da-4c39-9e12-41759dba24d6
18992025-01-02T23:34:07.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54829
19002025-01-02T23:34:07.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54829 req_id = d1e3b757-f5c5-4adb-8f71-a88d9fd5137a response_code = 200 uri = /v2p
19012025-01-02T23:34:07.210ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19022025-01-02T23:34:07.210ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6
19032025-01-02T23:34:07.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 313711 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60254 req_id = 0cb9a194-c94c-4675-af89-4f7fc1fce649 response_code = 200 uri = /inventory
19042025-01-02T23:34:07.229ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19052025-01-02T23:34:07.229ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_761fec61-ade0-4579-af52-842b38e6e3a3
19062025-01-02T23:34:07.258ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19072025-01-02T23:34:07.258ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24
19082025-01-02T23:34:07.287ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19092025-01-02T23:34:07.287ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5
19102025-01-02T23:34:07.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54798 req_id = 442161b4-2ab0-40d0-bb61-579d31176f95 response_code = 204 uri = /vpc-routes
19112025-01-02T23:34:07.317ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19122025-01-02T23:34:07.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3422f079-8bbb-4453-89ec-a156fe56575a
19132025-01-02T23:34:07.325ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
19142025-01-02T23:34:07.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 667 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46031 req_id = 9f6d5385-2495-4411-b660-85f13250fa87 response_code = 204 uri = /vpc-routes
19152025-01-02T23:34:07.344ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19162025-01-02T23:34:07.345ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd42dc62-762a-4947-84e6-57025e292015
19172025-01-02T23:34:07.369ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19182025-01-02T23:34:07.369ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d
19192025-01-02T23:34:07.395ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19202025-01-02T23:34:07.395ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6
19212025-01-02T23:34:07.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285348 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44325 req_id = 10a0f745-66d6-4ab0-903b-230e28fbabef response_code = 200 uri = /inventory
19222025-01-02T23:34:10.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38804
19232025-01-02T23:34:10.020ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19242025-01-02T23:34:10.020ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19252025-01-02T23:34:10.020ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19262025-01-02T23:34:10.020ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19272025-01-02T23:34:10.020ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19282025-01-02T23:34:10.020ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19292025-01-02T23:34:10.020ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19302025-01-02T23:34:10.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 824 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38804 req_id = e4201ea0-6e88-42f2-9e13-4acf22342889 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19312025-01-02T23:34:10.021ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1088
19322025-01-02T23:34:10.024ZINFOSledAgent (RSS): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19332025-01-02T23:34:10.025ZINFOSledAgent (RSS): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
19342025-01-02T23:34:10.060ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57000
19352025-01-02T23:34:10.061ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19362025-01-02T23:34:10.061ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19372025-01-02T23:34:10.061ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19382025-01-02T23:34:10.061ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19392025-01-02T23:34:10.061ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19402025-01-02T23:34:10.061ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19412025-01-02T23:34:10.061ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19422025-01-02T23:34:10.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57000 req_id = e0ff9b11-331c-4dd0-b3ce-43406fc88b92 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19432025-01-02T23:34:10.197ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35380
19442025-01-02T23:34:10.197ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19452025-01-02T23:34:10.197ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19462025-01-02T23:34:10.197ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19472025-01-02T23:34:10.197ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19482025-01-02T23:34:10.197ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19492025-01-02T23:34:10.197ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19502025-01-02T23:34:10.197ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19512025-01-02T23:34:10.197ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35380 req_id = 212dbc29-1473-4004-ab52-6feda735a479 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19522025-01-02T23:34:10.586ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33862
19532025-01-02T23:34:10.586ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
19542025-01-02T23:34:10.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19552025-01-02T23:34:10.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19562025-01-02T23:34:10.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19572025-01-02T23:34:10.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
19582025-01-02T23:34:10.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
19592025-01-02T23:34:10.586ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
19602025-01-02T23:34:10.587ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 339 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33862 req_id = d1261629-94a4-4a6a-9059-827bccd38b47 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19612025-01-02T23:34:10.831ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48355
19622025-01-02T23:34:10.831ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19632025-01-02T23:34:10.831ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
19642025-01-02T23:34:10.831ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
19652025-01-02T23:34:10.831ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
19662025-01-02T23:34:10.843ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19672025-01-02T23:34:10.843ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e
19682025-01-02T23:34:10.869ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19692025-01-02T23:34:10.869ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9c569eb8-99da-4c39-9e12-41759dba24d6
19702025-01-02T23:34:10.892ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19712025-01-02T23:34:10.892ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_761fec61-ade0-4579-af52-842b38e6e3a3
19722025-01-02T23:34:10.916ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19732025-01-02T23:34:10.916ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24
19742025-01-02T23:34:10.938ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19752025-01-02T23:34:10.938ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5
19762025-01-02T23:34:10.960ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19772025-01-02T23:34:10.960ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3422f079-8bbb-4453-89ec-a156fe56575a
19782025-01-02T23:34:10.981ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19792025-01-02T23:34:10.981ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd42dc62-762a-4947-84e6-57025e292015
19802025-01-02T23:34:11.002ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19812025-01-02T23:34:11.002ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d
19822025-01-02T23:34:11.024ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
19832025-01-02T23:34:11.024ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6
19842025-01-02T23:34:11.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205388 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48355 req_id = bc5797a4-9ccd-4dfe-b295-97d79808d17f response_code = 200 uri = /inventory
19852025-01-02T23:34:17.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35675
19862025-01-02T23:34:17.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35675 req_id = f8604821-92c8-4a04-a150-04486a64d9d0 response_code = 200 uri = /vpc-routes
19872025-01-02T23:34:17.469ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
19882025-01-02T23:34:17.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35675 req_id = 524ba834-5cdf-4601-8245-b4fbea4cbeec response_code = 204 uri = /eip-gateways
19892025-01-02T23:34:17.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 197 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35675 req_id = dc0b9d35-6c12-45df-9640-d5d34e4af3f6 response_code = 204 uri = /vpc-routes
19902025-01-02T23:34:29.378ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62800
19912025-01-02T23:34:29.378ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62800 req_id = ffa83a84-5f18-4815-ab55-6bcf6c58aa0c response_code = 200 uri = /baseboard
19922025-01-02T23:34:34.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52425
19932025-01-02T23:34:34.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52425 req_id = 21a0caa0-c6ac-4bd9-ac14-f482246efb42 response_code = 200 uri = /v2p
19942025-01-02T23:34:34.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61534
19952025-01-02T23:34:34.705ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61534 req_id = c93e42fa-8047-40d3-be49-9263f405122c response_code = 200 uri = /vpc-routes
19962025-01-02T23:34:34.719ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
19972025-01-02T23:34:34.719ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61534 req_id = 60edc0ba-9d8f-40f8-af8f-c3e9bd4fb567 response_code = 204 uri = /eip-gateways
19982025-01-02T23:34:34.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61534 req_id = 22b2efc6-ab1f-4968-b125-1fcf0f248b3e response_code = 204 uri = /vpc-routes
19992025-01-02T23:34:35.015ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63426
20002025-01-02T23:34:35.016ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20012025-01-02T23:34:35.086ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20022025-01-02T23:34:35.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131298 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63426 req_id = 56759267-fc39-40c6-90ab-31a6574c06ed response_code = 204 uri = /switch-ports
20032025-01-02T23:34:35.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 611 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63426 req_id = 1c17c113-9c1f-42a1-b880-e083c473561a response_code = 200 uri = /network-bootstore-config
20042025-01-02T23:34:35.224ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-buskin-i86pc
20052025-01-02T23:34:35.226ZINFOSledAgent (bootstore): Writing ledger to /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20062025-01-02T23:34:35.227ZINFOSledAgent (bootstore): Writing ledger to /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-buskin-i86pc
20072025-01-02T23:34:35.229ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-buskin-i86pc
20082025-01-02T23:34:35.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63426 req_id = 2b2520e4-d03e-46aa-9635-db1c58b86390 response_code = 204 uri = /network-bootstore-config
20092025-01-02T23:34:36.718ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48767
20102025-01-02T23:34:36.718ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48767 req_id = 7702eb00-b235-4c33-b0ad-4c596aacaa67 response_code = 200 uri = /vpc-routes
20112025-01-02T23:34:36.760ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
20122025-01-02T23:34:36.760ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48767 req_id = b50997e9-e97a-4e26-8e71-f31256f4ad79 response_code = 204 uri = /eip-gateways
20132025-01-02T23:34:36.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48767 req_id = 0612c509-e614-4334-a120-5f9b198643ec response_code = 204 uri = /vpc-routes
20142025-01-02T23:34:36.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46808
20152025-01-02T23:34:36.852ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20162025-01-02T23:34:36.889ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20172025-01-02T23:34:36.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114655 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46808 req_id = bd548461-107d-4463-80e0-05ac93bfc6f2 response_code = 204 uri = /switch-ports
20182025-01-02T23:34:36.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58322
20192025-01-02T23:34:36.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34779
20202025-01-02T23:34:36.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46808 req_id = 510108a3-14ae-46ae-b3f4-1ce1d4c5f102 response_code = 200 uri = /network-bootstore-config
20212025-01-02T23:34:36.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34779 req_id = e0d9c629-d5c4-4135-8f71-b8f6ad82c8ab response_code = 200 uri = /vpc-routes
20222025-01-02T23:34:36.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58322 req_id = 3def8832-cfd2-43f0-97ad-b832c91f1fd5 response_code = 200 uri = /v2p
20232025-01-02T23:34:37.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
20242025-01-02T23:34:37.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34779 req_id = 30917090-0e13-4523-a520-0d25b82d6954 response_code = 204 uri = /eip-gateways
20252025-01-02T23:34:37.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34779 req_id = 3bdda634-d69e-4c84-a475-b89c370c3d3b response_code = 204 uri = /vpc-routes
20262025-01-02T23:34:37.069ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43329
20272025-01-02T23:34:37.069ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20282025-01-02T23:34:37.106ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20292025-01-02T23:34:37.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96909 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43329 req_id = 17a7763e-1657-4680-9872-aa75629a33dc response_code = 204 uri = /switch-ports
20302025-01-02T23:34:37.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44262
20312025-01-02T23:34:37.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43329 req_id = 8dea6ed2-efa0-4286-9284-836ed1976d0f response_code = 200 uri = /network-bootstore-config
20322025-01-02T23:34:37.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44262 req_id = ce3fe260-b74d-4d8b-8fcb-80460b027b5c response_code = 200 uri = /v2p
20332025-01-02T23:34:50.801ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
20342025-01-02T23:34:58.823ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:44001 remote_addr = [fd00:1122:3344:101::d]:59735 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
20352025-01-02T23:34:58.848ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25157 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 25ad87d6-68e6-45a8-b8f8-17bb3aa0a2ea response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
20362025-01-02T23:34:59.412ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48646
20372025-01-02T23:34:59.412ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48646 req_id = b39e537c-c90c-4a5a-8c71-680b26ddecb7 response_code = 200 uri = /baseboard
20382025-01-02T23:35:04.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41763
20392025-01-02T23:35:04.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41763 req_id = 514c4a82-201d-4de4-aa5b-04bc390027d8 response_code = 200 uri = /vpc-routes
20402025-01-02T23:35:04.773ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39238
20412025-01-02T23:35:04.774ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39238 req_id = 18e3f526-c65c-4078-b420-b1a85116d506 response_code = 200 uri = /v2p
20422025-01-02T23:35:04.894ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
20432025-01-02T23:35:04.894ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41763 req_id = c22fbcf2-9512-450d-9567-4e76c4b523a4 response_code = 204 uri = /eip-gateways
20442025-01-02T23:35:04.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41763 req_id = 5b7f0e30-3860-4f2f-8225-37b5b3ae8227 response_code = 204 uri = /vpc-routes
20452025-01-02T23:35:05.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45647
20462025-01-02T23:35:05.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20472025-01-02T23:35:05.154ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20482025-01-02T23:35:05.209ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92139 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45647 req_id = 16756440-787d-4d06-aa42-b02ba2352ff3 response_code = 204 uri = /switch-ports
20492025-01-02T23:35:05.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45647 req_id = 5bccbf9b-e192-4c72-b8b7-71d1c26439e9 response_code = 200 uri = /network-bootstore-config
20502025-01-02T23:35:06.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36709
20512025-01-02T23:35:06.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36709 req_id = 79015801-dc32-4ff4-95ff-3061df85e271 response_code = 200 uri = /v2p
20522025-01-02T23:35:06.672ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60536
20532025-01-02T23:35:06.672ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60536 req_id = 42a1d7a4-b774-4222-853b-1fb7ebfa9020 response_code = 200 uri = /vpc-routes
20542025-01-02T23:35:06.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
20552025-01-02T23:35:06.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60536 req_id = 21e6b65d-8a33-49f5-a4e2-f1f906f52f8d response_code = 204 uri = /eip-gateways
20562025-01-02T23:35:06.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60536 req_id = 91fb6f7e-e6e8-4540-a824-2560b553a068 response_code = 204 uri = /vpc-routes
20572025-01-02T23:35:07.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50222
20582025-01-02T23:35:07.019ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20592025-01-02T23:35:07.052ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20602025-01-02T23:35:07.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83725 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50222 req_id = 0e3f7b90-38d9-4bee-be40-52e0f7cbc3d8 response_code = 204 uri = /switch-ports
20612025-01-02T23:35:07.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64582
20622025-01-02T23:35:07.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64582 req_id = 7eaacfab-af0c-494d-9d74-7065d8033cae response_code = 200 uri = /vpc-routes
20632025-01-02T23:35:07.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50222 req_id = 2a4411b1-225f-413e-915b-2961e9df0076 response_code = 200 uri = /network-bootstore-config
20642025-01-02T23:35:07.143ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
20652025-01-02T23:35:07.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64582 req_id = 8659b60e-15d2-4203-b684-7fbfee066b3f response_code = 204 uri = /eip-gateways
20662025-01-02T23:35:07.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64582 req_id = e4562e34-03e9-4554-98e2-593d245526f2 response_code = 204 uri = /vpc-routes
20672025-01-02T23:35:07.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38681
20682025-01-02T23:35:07.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38681 req_id = 0f1d6990-efa1-46df-a36f-3090bbf1751b response_code = 200 uri = /v2p
20692025-01-02T23:35:07.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33631
20702025-01-02T23:35:07.296ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20712025-01-02T23:35:07.337ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20722025-01-02T23:35:07.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98239 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33631 req_id = 7f3fbeb5-be14-4026-88cd-31c4472b0cba response_code = 204 uri = /switch-ports
20732025-01-02T23:35:07.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33631 req_id = 6dcb8ab3-13d4-4564-956b-cd9e5e16c6a3 response_code = 200 uri = /network-bootstore-config
20742025-01-02T23:35:28.829ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7494 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 823c660a-a0de-4e8f-b844-71d9fb001601 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
20752025-01-02T23:35:29.444ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49202
20762025-01-02T23:35:29.444ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:49202 req_id = 284d3b08-222e-4877-b9be-ab0dab38bbb9 response_code = 200 uri = /baseboard
20772025-01-02T23:35:34.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38455
20782025-01-02T23:35:34.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38455 req_id = 876ec876-faeb-4e0d-a55c-b082913beca4 response_code = 200 uri = /vpc-routes
20792025-01-02T23:35:34.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
20802025-01-02T23:35:34.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38455 req_id = f445ec03-5626-4cef-b3da-5eba36bbd1f2 response_code = 204 uri = /eip-gateways
20812025-01-02T23:35:34.704ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42045
20822025-01-02T23:35:34.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42045 req_id = 62638383-230b-4cee-99e5-c46923d04cc2 response_code = 200 uri = /v2p
20832025-01-02T23:35:34.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38455 req_id = b2bef237-245c-40d1-9076-0b55d555fb29 response_code = 204 uri = /vpc-routes
20842025-01-02T23:35:34.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44308
20852025-01-02T23:35:34.895ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20862025-01-02T23:35:34.932ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20872025-01-02T23:35:34.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93987 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44308 req_id = 183b409d-347e-4805-9004-3432e1b094ac response_code = 204 uri = /switch-ports
20882025-01-02T23:35:34.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44308 req_id = 7a8e59d4-48f0-434f-b71b-abb25d933d58 response_code = 200 uri = /network-bootstore-config
20892025-01-02T23:35:36.599ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33625
20902025-01-02T23:35:36.599ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33625 req_id = 225c1213-04f5-405d-82db-89f39fc91990 response_code = 200 uri = /vpc-routes
20912025-01-02T23:35:36.645ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
20922025-01-02T23:35:36.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 739 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33625 req_id = 01db00a1-5868-42f4-a588-5780805cf0c5 response_code = 204 uri = /eip-gateways
20932025-01-02T23:35:36.653ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33625 req_id = edcab554-4a7c-4d0c-ac7c-c633bb3e7b55 response_code = 204 uri = /vpc-routes
20942025-01-02T23:35:36.726ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33539
20952025-01-02T23:35:36.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33539 req_id = faaa0cec-ce5b-4d0a-a5e5-324f0f8f86ad response_code = 200 uri = /v2p
20962025-01-02T23:35:36.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52196
20972025-01-02T23:35:36.740ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
20982025-01-02T23:35:36.784ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
20992025-01-02T23:35:36.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122964 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:52196 req_id = 6527a445-ea70-4bbb-b2ca-2a61e1c6b71a response_code = 204 uri = /switch-ports
21002025-01-02T23:35:36.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52196 req_id = 2f547f7e-6743-472a-8df4-3f68e4a823e8 response_code = 200 uri = /network-bootstore-config
21012025-01-02T23:35:36.911ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38473
21022025-01-02T23:35:36.911ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38473 req_id = d97f4f50-3d22-416b-9ab8-6bf4a4d98392 response_code = 200 uri = /vpc-routes
21032025-01-02T23:35:36.955ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
21042025-01-02T23:35:36.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38473 req_id = 582744e3-5824-4ddd-b595-01220eb43b73 response_code = 204 uri = /eip-gateways
21052025-01-02T23:35:36.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 243 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38473 req_id = fd0cff62-af3a-4f81-90ec-07ca7ed0d356 response_code = 204 uri = /vpc-routes
21062025-01-02T23:35:37.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54260
21072025-01-02T23:35:37.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54260 req_id = 12bf7d3b-cccb-4471-931f-f472c183947a response_code = 200 uri = /v2p
21082025-01-02T23:35:37.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35974
21092025-01-02T23:35:37.412ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21102025-01-02T23:35:37.449ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21112025-01-02T23:35:37.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35974 req_id = 0f03380f-a1e6-47bb-8558-19db8f8d77c8 response_code = 204 uri = /switch-ports
21122025-01-02T23:35:37.503ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35974 req_id = 5b68399a-cb85-48f6-8f5f-4751fe7a39c2 response_code = 200 uri = /network-bootstore-config
21132025-01-02T23:35:58.828ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6189 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = f0ae22b9-a4f1-4e06-a070-154d886ab6c1 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
21142025-01-02T23:35:59.480ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64452
21152025-01-02T23:35:59.480ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64452 req_id = 9888851a-733e-4a1e-a792-586e32017184 response_code = 200 uri = /baseboard
21162025-01-02T23:36:04.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39727
21172025-01-02T23:36:04.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39727 req_id = 4ee1ec9d-05dc-4874-985d-ead355508513 response_code = 200 uri = /vpc-routes
21182025-01-02T23:36:04.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
21192025-01-02T23:36:04.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39727 req_id = 97621cc1-5197-4ffa-aa39-2e56f9071ff7 response_code = 204 uri = /eip-gateways
21202025-01-02T23:36:04.914ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53048
21212025-01-02T23:36:04.914ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53048 req_id = 2d667f57-6912-4f80-9b3d-db980d100efc response_code = 200 uri = /v2p
21222025-01-02T23:36:04.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 305 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39727 req_id = b15b9f7f-61c8-4aba-bde5-cdc120b9da24 response_code = 204 uri = /vpc-routes
21232025-01-02T23:36:05.135ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38543
21242025-01-02T23:36:05.135ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21252025-01-02T23:36:05.174ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21262025-01-02T23:36:05.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38543 req_id = 8a231248-e8e7-4f88-b62a-8987d4b594dd response_code = 204 uri = /switch-ports
21272025-01-02T23:36:05.233ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38543 req_id = 1fc3dcd9-4c5c-4b5b-bc5a-85fb5bdcfa8c response_code = 200 uri = /network-bootstore-config
21282025-01-02T23:36:06.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61275
21292025-01-02T23:36:06.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61275 req_id = ea557461-eb55-4117-a136-eb5f9a23ebbd response_code = 200 uri = /vpc-routes
21302025-01-02T23:36:06.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63345
21312025-01-02T23:36:06.969ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21322025-01-02T23:36:07.010ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21332025-01-02T23:36:07.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101128 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63345 req_id = 593c4124-552c-433f-9448-88bf083b1492 response_code = 204 uri = /switch-ports
21342025-01-02T23:36:07.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45204
21352025-01-02T23:36:07.070ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
21362025-01-02T23:36:07.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61275 req_id = dc084010-f152-401a-bdbe-23eb37698f2c response_code = 204 uri = /eip-gateways
21372025-01-02T23:36:07.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63345 req_id = e58c28ea-106c-4ced-bbef-2ab0e347a8b7 response_code = 200 uri = /network-bootstore-config
21382025-01-02T23:36:07.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 319 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45204 req_id = 8e04a3b1-b011-4d45-8d9c-86b539ac15da response_code = 200 uri = /v2p
21392025-01-02T23:36:07.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34202
21402025-01-02T23:36:07.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34202 req_id = d3e8a014-1ffd-447d-9894-f084fcfbcea1 response_code = 200 uri = /vpc-routes
21412025-01-02T23:36:07.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61275 req_id = 47f46b95-da10-4cc0-9ae4-8fedf6f6fb99 response_code = 204 uri = /vpc-routes
21422025-01-02T23:36:07.128ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
21432025-01-02T23:36:07.128ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34202 req_id = 5dc03728-4a40-4fbf-ad68-8698468bc3c3 response_code = 204 uri = /eip-gateways
21442025-01-02T23:36:07.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34202 req_id = f1b158e4-ae99-4aed-b472-a74762834a88 response_code = 204 uri = /vpc-routes
21452025-01-02T23:36:07.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47869
21462025-01-02T23:36:07.196ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47869 req_id = 4026f2ad-05bc-42d8-a8c7-45d08bdd5bb0 response_code = 200 uri = /v2p
21472025-01-02T23:36:07.354ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51968
21482025-01-02T23:36:07.354ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21492025-01-02T23:36:07.391ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21502025-01-02T23:36:07.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92440 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51968 req_id = 67d8ecb9-f62b-4d5f-977d-b1cea8c05147 response_code = 204 uri = /switch-ports
21512025-01-02T23:36:07.447ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51968 req_id = 6e6c3018-4c4c-4a7e-ba5c-9ecdcee9dc50 response_code = 200 uri = /network-bootstore-config
21522025-01-02T23:36:28.829ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6680 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 2c22dec7-21c9-4d9f-bb91-4e3bfd6bab91 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
21532025-01-02T23:36:29.513ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53280
21542025-01-02T23:36:29.513ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53280 req_id = e74553fa-33d3-473c-8370-e41f61712de5 response_code = 200 uri = /baseboard
21552025-01-02T23:36:34.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56576
21562025-01-02T23:36:34.564ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56576 req_id = 4009a4a2-e116-4858-b13d-eee79d3c3efd response_code = 200 uri = /vpc-routes
21572025-01-02T23:36:34.704ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
21582025-01-02T23:36:34.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56576 req_id = 637fdadd-7d8e-4269-9cc5-9ab6f7bac1e2 response_code = 204 uri = /eip-gateways
21592025-01-02T23:36:34.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 224 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56576 req_id = 7ba41504-6360-4e34-ad12-3b88387af3c3 response_code = 204 uri = /vpc-routes
21602025-01-02T23:36:34.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65463
21612025-01-02T23:36:34.789ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21622025-01-02T23:36:34.826ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21632025-01-02T23:36:34.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94979 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65463 req_id = 773505ba-0c71-4c3c-8a79-fe1fae86ccaa response_code = 204 uri = /switch-ports
21642025-01-02T23:36:34.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65463 req_id = c54dd2e0-66c6-4eab-b541-0c88d213cc8c response_code = 200 uri = /network-bootstore-config
21652025-01-02T23:36:34.951ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58395
21662025-01-02T23:36:34.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58395 req_id = 3e2f0d0a-459a-4422-856a-918aa8041e99 response_code = 200 uri = /v2p
21672025-01-02T23:36:36.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50392
21682025-01-02T23:36:36.590ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50392 req_id = 9eddfbd4-0f19-4f29-88f7-8a6e25d724df response_code = 200 uri = /vpc-routes
21692025-01-02T23:36:36.639ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
21702025-01-02T23:36:36.639ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50392 req_id = 8f718e64-145c-4a2d-976f-8f6d43c02d75 response_code = 204 uri = /eip-gateways
21712025-01-02T23:36:36.652ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50392 req_id = c4d40be2-f8cc-40bc-bf22-8098a590b52e response_code = 204 uri = /vpc-routes
21722025-01-02T23:36:36.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47647
21732025-01-02T23:36:36.673ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21742025-01-02T23:36:36.714ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21752025-01-02T23:36:36.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107796 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47647 req_id = ed823056-986a-48a5-979b-c57293fb42f1 response_code = 204 uri = /switch-ports
21762025-01-02T23:36:36.782ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33960
21772025-01-02T23:36:36.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47647 req_id = 17a993ad-6923-44cb-82d4-ff4a016b6c8d response_code = 200 uri = /network-bootstore-config
21782025-01-02T23:36:36.782ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33960 req_id = e9738af1-bfbe-4fe4-8fc0-9cff66080058 response_code = 200 uri = /v2p
21792025-01-02T23:36:37.198ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64953
21802025-01-02T23:36:37.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64953 req_id = f6b5b5df-f095-402b-88e0-43456d0a4601 response_code = 200 uri = /vpc-routes
21812025-01-02T23:36:37.242ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
21822025-01-02T23:36:37.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64953 req_id = 6bb1f0a3-f281-49aa-82e8-e31b587e9bcd response_code = 204 uri = /eip-gateways
21832025-01-02T23:36:37.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64953 req_id = 23d1abf2-ceba-4bab-b83b-07a504325daf response_code = 204 uri = /vpc-routes
21842025-01-02T23:36:37.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51671
21852025-01-02T23:36:37.287ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
21862025-01-02T23:36:37.324ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
21872025-01-02T23:36:37.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51671 req_id = ca5e1752-e2b4-4132-b403-5da292919ee2 response_code = 204 uri = /switch-ports
21882025-01-02T23:36:37.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36202
21892025-01-02T23:36:37.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36202 req_id = d36f7193-a613-40db-8176-5622086c4f11 response_code = 200 uri = /v2p
21902025-01-02T23:36:37.381ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51671 req_id = e040dc3f-e03c-4671-81be-51f694f7aa60 response_code = 200 uri = /network-bootstore-config
21912025-01-02T23:36:58.830ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7211 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 7d9f9340-7d37-4808-8402-91a32619ca36 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
21922025-01-02T23:36:59.547ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63414
21932025-01-02T23:36:59.547ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63414 req_id = c9e8b76a-90b5-40fb-8bd1-1801b3b5381c response_code = 200 uri = /baseboard
21942025-01-02T23:37:04.740ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54767
21952025-01-02T23:37:04.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54767 req_id = 13bb6560-2553-4656-a290-8522a8534d10 response_code = 200 uri = /vpc-routes
21962025-01-02T23:37:04.788ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
21972025-01-02T23:37:04.788ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54767 req_id = 94fa319e-7d41-464d-ad9e-3646d990aa17 response_code = 204 uri = /eip-gateways
21982025-01-02T23:37:04.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54767 req_id = fd08ceec-7a61-4d51-a26b-2d81e5e7a99e response_code = 204 uri = /vpc-routes
21992025-01-02T23:37:04.997ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63099
22002025-01-02T23:37:04.997ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63099 req_id = 91a2eafa-1977-4923-9e41-996505ba66a3 response_code = 200 uri = /v2p
22012025-01-02T23:37:05.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38053
22022025-01-02T23:37:05.259ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22032025-01-02T23:37:05.294ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22042025-01-02T23:37:05.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88001 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38053 req_id = 333b632b-0a40-4f0c-843e-bd87b7e6a91c response_code = 204 uri = /switch-ports
22052025-01-02T23:37:05.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38053 req_id = e8f74ec9-058e-433b-8b0a-858cbacbcdd9 response_code = 200 uri = /network-bootstore-config
22062025-01-02T23:37:06.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37292
22072025-01-02T23:37:06.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37292 req_id = 6a422d09-fed4-4c83-a27a-6c47cbe6aa0b response_code = 200 uri = /v2p
22082025-01-02T23:37:06.917ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38260
22092025-01-02T23:37:06.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38260 req_id = 89cfc667-8c0c-4690-8db1-cb8527b1ae6e response_code = 200 uri = /vpc-routes
22102025-01-02T23:37:06.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44909
22112025-01-02T23:37:06.960ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22122025-01-02T23:37:06.998ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22132025-01-02T23:37:07.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44909 req_id = 367a86e2-882a-4524-a7ef-91d0f5c31d50 response_code = 204 uri = /switch-ports
22142025-01-02T23:37:07.065ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57295
22152025-01-02T23:37:07.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
22162025-01-02T23:37:07.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38260 req_id = 7bd9f486-45e1-4860-bdb3-27ab12c54f95 response_code = 204 uri = /eip-gateways
22172025-01-02T23:37:07.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44909 req_id = c1d17888-88e5-4836-8ee3-a6fd6961bb2f response_code = 200 uri = /network-bootstore-config
22182025-01-02T23:37:07.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57295 req_id = e19aa429-a53a-4cda-b1b7-fbce6cc9c1be response_code = 200 uri = /vpc-routes
22192025-01-02T23:37:07.112ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
22202025-01-02T23:37:07.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57295 req_id = 2ee2dfa6-6f0e-4af6-b1fa-96b80f634880 response_code = 204 uri = /eip-gateways
22212025-01-02T23:37:07.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57295 req_id = 1ab900e9-77a0-4249-849f-72f7f661f798 response_code = 204 uri = /vpc-routes
22222025-01-02T23:37:07.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:38260 req_id = a7a0bbef-46a8-4375-9367-aa02a579ad1f response_code = 204 uri = /vpc-routes
22232025-01-02T23:37:07.239ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35652
22242025-01-02T23:37:07.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35652 req_id = 99082f69-2667-4b27-8b97-dab7874564b3 response_code = 200 uri = /v2p
22252025-01-02T23:37:07.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47905
22262025-01-02T23:37:07.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22272025-01-02T23:37:07.277ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22282025-01-02T23:37:07.332ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91562 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:47905 req_id = add49f48-c457-4da5-9428-078673477d8a response_code = 204 uri = /switch-ports
22292025-01-02T23:37:07.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47905 req_id = 21446dae-0477-4b3b-9048-c4e019869829 response_code = 200 uri = /network-bootstore-config
22302025-01-02T23:37:28.830ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6619 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 9f7c9290-a42e-4928-9752-668aaca7cd83 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
22312025-01-02T23:37:29.582ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51482
22322025-01-02T23:37:29.582ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51482 req_id = ed9e5d35-7dca-4cd1-a563-e07c619314a4 response_code = 200 uri = /baseboard
22332025-01-02T23:37:34.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35479
22342025-01-02T23:37:34.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35479 req_id = 7c75f2de-e95e-491d-8f1d-03b054c08242 response_code = 200 uri = /vpc-routes
22352025-01-02T23:37:34.765ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
22362025-01-02T23:37:34.765ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35479 req_id = 79f566c1-dc96-40d3-86b4-23c3f1ffc33d response_code = 204 uri = /eip-gateways
22372025-01-02T23:37:34.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35479 req_id = 1b01bfd8-276e-4593-bbf7-9a9c0b07f147 response_code = 204 uri = /vpc-routes
22382025-01-02T23:37:34.818ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33646
22392025-01-02T23:37:34.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33646 req_id = 938fcce2-ef88-4e1f-a600-1729f00e1227 response_code = 200 uri = /v2p
22402025-01-02T23:37:34.937ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57347
22412025-01-02T23:37:34.937ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22422025-01-02T23:37:34.974ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22432025-01-02T23:37:35.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92926 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57347 req_id = a44aa8d7-6df0-426f-bad8-bb9fb2daaae7 response_code = 204 uri = /switch-ports
22442025-01-02T23:37:35.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57347 req_id = 301d0623-ca4e-456a-915c-89e98daccff6 response_code = 200 uri = /network-bootstore-config
22452025-01-02T23:37:36.648ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50177
22462025-01-02T23:37:36.648ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50177 req_id = 476baa88-304f-4255-b541-f0acca531c0d response_code = 200 uri = /vpc-routes
22472025-01-02T23:37:36.663ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
22482025-01-02T23:37:36.663ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50177 req_id = 6b313d08-7fd0-41ec-999d-a1fc870e5f49 response_code = 204 uri = /eip-gateways
22492025-01-02T23:37:36.676ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50177 req_id = 47840682-9b49-4781-ac16-9dd2015dab8c response_code = 204 uri = /vpc-routes
22502025-01-02T23:37:36.776ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39757
22512025-01-02T23:37:36.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39757 req_id = 17cd5f93-459c-459a-9ad7-e9faaf6ba1e0 response_code = 200 uri = /v2p
22522025-01-02T23:37:36.852ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54625
22532025-01-02T23:37:36.852ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22542025-01-02T23:37:36.896ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22552025-01-02T23:37:36.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102560 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54625 req_id = 1aba34da-5acc-4ac4-975b-31983352f26d response_code = 204 uri = /switch-ports
22562025-01-02T23:37:36.970ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54625 req_id = a005af3f-ac8a-4cf2-ba73-bd2a274e2da6 response_code = 200 uri = /network-bootstore-config
22572025-01-02T23:37:36.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36152
22582025-01-02T23:37:36.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36152 req_id = f08bbad7-29d9-4fce-88a6-fd006bff2453 response_code = 200 uri = /vpc-routes
22592025-01-02T23:37:37.023ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
22602025-01-02T23:37:37.023ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36152 req_id = 5f8e4ae5-ab62-4fe1-a5e4-63d42cd491ae response_code = 204 uri = /eip-gateways
22612025-01-02T23:37:37.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 355 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36152 req_id = 91876d4b-13ad-4942-94e2-b423dc282e2b response_code = 204 uri = /vpc-routes
22622025-01-02T23:37:37.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54165
22632025-01-02T23:37:37.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54165 req_id = b0e8c343-7c6d-4e2b-b430-88ff1957ded7 response_code = 200 uri = /v2p
22642025-01-02T23:37:37.075ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54607
22652025-01-02T23:37:37.075ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22662025-01-02T23:37:37.112ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22672025-01-02T23:37:37.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93283 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54607 req_id = dca71a4c-091c-45f9-b9b8-ca28225f3728 response_code = 204 uri = /switch-ports
22682025-01-02T23:37:37.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54607 req_id = 3daf9351-3ef9-4cde-b11e-1c84de380cf9 response_code = 200 uri = /network-bootstore-config
22692025-01-02T23:37:58.830ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6367 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 24bb2183-d657-4b7c-9adc-e092f8d8f2b6 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
22702025-01-02T23:37:59.614ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64150
22712025-01-02T23:37:59.614ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64150 req_id = f0e22ba8-0b19-4d31-acfd-c01832ac9995 response_code = 200 uri = /baseboard
22722025-01-02T23:38:04.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58032
22732025-01-02T23:38:04.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58032 req_id = 4ee0ed6a-83e3-4c07-92d7-7121698331b1 response_code = 200 uri = /v2p
22742025-01-02T23:38:04.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41499
22752025-01-02T23:38:04.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41499 req_id = 92485425-57ec-4658-8d74-f875674e45f8 response_code = 200 uri = /vpc-routes
22762025-01-02T23:38:04.913ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
22772025-01-02T23:38:04.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41499 req_id = 4aafac83-c6d0-4cd9-b142-85c20d7d3ca9 response_code = 204 uri = /eip-gateways
22782025-01-02T23:38:04.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41499 req_id = 1b2ebd2c-19a7-4d1d-9995-8eddb80ec06d response_code = 204 uri = /vpc-routes
22792025-01-02T23:38:04.928ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58814
22802025-01-02T23:38:04.929ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22812025-01-02T23:38:04.965ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22822025-01-02T23:38:05.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90970 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58814 req_id = 7b9ea894-ee18-4f86-8c98-9f84f973d864 response_code = 204 uri = /switch-ports
22832025-01-02T23:38:05.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58814 req_id = d9ec1d3f-da93-4dc8-a43d-331c316dec22 response_code = 200 uri = /network-bootstore-config
22842025-01-02T23:38:06.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60188
22852025-01-02T23:38:06.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60188 req_id = 858060fe-7327-4beb-b0a6-43381ef4ec36 response_code = 200 uri = /vpc-routes
22862025-01-02T23:38:06.785ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
22872025-01-02T23:38:06.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60188 req_id = 4862db74-286f-4082-8e62-2cdd0972ff05 response_code = 204 uri = /eip-gateways
22882025-01-02T23:38:06.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 317 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60188 req_id = c15214cb-1d8b-4e6e-b812-84ce0666361e response_code = 204 uri = /vpc-routes
22892025-01-02T23:38:06.947ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43434
22902025-01-02T23:38:06.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43434 req_id = fbc4fa76-02e3-459f-b9df-3b46fc91210f response_code = 200 uri = /v2p
22912025-01-02T23:38:06.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49013
22922025-01-02T23:38:06.976ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
22932025-01-02T23:38:07.013ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
22942025-01-02T23:38:07.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116568 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49013 req_id = 194de56a-037a-492c-8894-878609723c22 response_code = 204 uri = /switch-ports
22952025-01-02T23:38:07.093ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50267
22962025-01-02T23:38:07.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50267 req_id = ad8bf616-8df0-4b41-8567-da0af7b59448 response_code = 200 uri = /vpc-routes
22972025-01-02T23:38:07.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49013 req_id = ec004b33-7096-43eb-99ec-58057a0e0963 response_code = 200 uri = /network-bootstore-config
22982025-01-02T23:38:07.146ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
22992025-01-02T23:38:07.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50267 req_id = 18eba1e3-2389-4dfa-99bc-512c870b5fb9 response_code = 204 uri = /eip-gateways
23002025-01-02T23:38:07.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50267 req_id = e7988c30-070e-4a43-8bcd-ea3da981724d response_code = 204 uri = /vpc-routes
23012025-01-02T23:38:07.267ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49412
23022025-01-02T23:38:07.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49412 req_id = eeeedf24-72fd-45c4-a27e-a06a33d692a0 response_code = 200 uri = /v2p
23032025-01-02T23:38:07.430ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55322
23042025-01-02T23:38:07.430ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23052025-01-02T23:38:07.471ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23062025-01-02T23:38:07.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55322 req_id = d33a74ec-f5d6-4f4c-bffe-71eb75f4daaa response_code = 204 uri = /switch-ports
23072025-01-02T23:38:07.533ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55322 req_id = 877f93fc-fd35-4839-9b1f-0ae047267bff response_code = 200 uri = /network-bootstore-config
23082025-01-02T23:38:28.830ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6546 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 8ff5e157-d6f8-4881-8999-d8f0783fb697 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
23092025-01-02T23:38:29.649ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33916
23102025-01-02T23:38:29.649ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:33916 req_id = 02048b26-0bde-4ceb-b8fa-72cb7ce9c739 response_code = 200 uri = /baseboard
23112025-01-02T23:38:34.632ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50549
23122025-01-02T23:38:34.632ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50549 req_id = 5518b61f-b936-4219-b1df-8409c346c901 response_code = 200 uri = /vpc-routes
23132025-01-02T23:38:34.646ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
23142025-01-02T23:38:34.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50549 req_id = a5b59316-113a-44f9-b6a1-65136c3e1055 response_code = 204 uri = /eip-gateways
23152025-01-02T23:38:34.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50549 req_id = 1f1476b5-93e6-459a-a10e-e0a7d99a7b5b response_code = 204 uri = /vpc-routes
23162025-01-02T23:38:34.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37731
23172025-01-02T23:38:34.733ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37731 req_id = 35f154f2-9662-4ec3-b9ce-17c00da2d2d9 response_code = 200 uri = /v2p
23182025-01-02T23:38:34.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64846
23192025-01-02T23:38:34.785ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23202025-01-02T23:38:34.823ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23212025-01-02T23:38:34.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93963 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64846 req_id = a07ddbfe-0747-4848-909c-e891079b5c65 response_code = 204 uri = /switch-ports
23222025-01-02T23:38:34.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64846 req_id = 83332487-4cdb-4f88-8d86-dfb8d10530a8 response_code = 200 uri = /network-bootstore-config
23232025-01-02T23:38:36.537ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63596
23242025-01-02T23:38:36.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63596 req_id = d8ec727e-ae49-415c-af06-77f2535eedcd response_code = 200 uri = /vpc-routes
23252025-01-02T23:38:36.593ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
23262025-01-02T23:38:36.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63596 req_id = 68373400-b053-46de-8f66-cdb8deedc9ac response_code = 204 uri = /eip-gateways
23272025-01-02T23:38:36.602ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63596 req_id = 7747b1c5-71ea-4b76-8719-870cfe980140 response_code = 204 uri = /vpc-routes
23282025-01-02T23:38:36.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47176
23292025-01-02T23:38:36.679ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23302025-01-02T23:38:36.714ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23312025-01-02T23:38:36.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88532 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47176 req_id = ba355af2-d887-4713-bb33-0865e9782b43 response_code = 204 uri = /switch-ports
23322025-01-02T23:38:36.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55214
23332025-01-02T23:38:36.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55214 req_id = 178439b4-dbac-43d0-9171-3d3e7a2ecbcb response_code = 200 uri = /v2p
23342025-01-02T23:38:36.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47176 req_id = 44b62435-d55b-43f6-8f93-95db1a8e86c7 response_code = 200 uri = /network-bootstore-config
23352025-01-02T23:38:37.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54642
23362025-01-02T23:38:37.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54642 req_id = 29a1eaa3-36c3-4465-bd3b-ce5ec4a83c7f response_code = 200 uri = /vpc-routes
23372025-01-02T23:38:37.044ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
23382025-01-02T23:38:37.044ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54642 req_id = 3bdaabc6-8077-4453-b186-9ffd882b2d24 response_code = 204 uri = /eip-gateways
23392025-01-02T23:38:37.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:54642 req_id = a84dbf5d-8e60-4446-bf7a-e62d0a887a9c response_code = 204 uri = /vpc-routes
23402025-01-02T23:38:37.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43054
23412025-01-02T23:38:37.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43054 req_id = 08c67e0a-f5e8-4b10-b5eb-4dcd8dc95d3d response_code = 200 uri = /v2p
23422025-01-02T23:38:37.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52994
23432025-01-02T23:38:37.117ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23442025-01-02T23:38:37.156ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23452025-01-02T23:38:37.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92548 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52994 req_id = 47311843-eacc-4674-9788-9b0bfaec6234 response_code = 204 uri = /switch-ports
23462025-01-02T23:38:37.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52994 req_id = bc58c375-020a-49da-9525-3d9b36d950b1 response_code = 200 uri = /network-bootstore-config
23472025-01-02T23:38:58.832ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7496 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 68216740-589d-401b-9155-2794d9bbcc23 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
23482025-01-02T23:38:59.684ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48056
23492025-01-02T23:38:59.684ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:48056 req_id = b55f21a2-f60a-44ec-8fc1-a256446d003e response_code = 200 uri = /baseboard
23502025-01-02T23:39:04.817ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57183
23512025-01-02T23:39:04.818ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57183 req_id = 22dc169f-bcf9-49e7-a698-eb108db4a31d response_code = 200 uri = /vpc-routes
23522025-01-02T23:39:04.866ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
23532025-01-02T23:39:04.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57183 req_id = b0bab5f6-9c51-4337-b83c-89dd0cb0d810 response_code = 204 uri = /eip-gateways
23542025-01-02T23:39:04.877ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57183 req_id = c97472b9-5b53-4a34-8d8a-4edd1ec9e86b response_code = 204 uri = /vpc-routes
23552025-01-02T23:39:04.974ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51328
23562025-01-02T23:39:04.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51328 req_id = cea7c2a6-26f4-46b4-8274-492a9d0d3a0b response_code = 200 uri = /v2p
23572025-01-02T23:39:04.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47217
23582025-01-02T23:39:04.976ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23592025-01-02T23:39:05.018ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23602025-01-02T23:39:05.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93604 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47217 req_id = e9bd94c4-d1a5-4b18-a22e-9a5e9928e41a response_code = 204 uri = /switch-ports
23612025-01-02T23:39:05.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47217 req_id = 73718a35-af51-40ee-a09e-8a059d7a951a response_code = 200 uri = /network-bootstore-config
23622025-01-02T23:39:05.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53228
23632025-01-02T23:39:05.205ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23642025-01-02T23:39:05.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23652025-01-02T23:39:05.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23662025-01-02T23:39:05.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23672025-01-02T23:39:05.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23682025-01-02T23:39:05.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23692025-01-02T23:39:05.205ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23702025-01-02T23:39:05.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53228 req_id = db9ee769-f8d5-4aad-afaa-1ddad2b5554e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23712025-01-02T23:39:06.577ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37752
23722025-01-02T23:39:06.577ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37752 req_id = 45d10b26-1e28-470c-9b68-5644afb29693 response_code = 200 uri = /vpc-routes
23732025-01-02T23:39:06.645ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
23742025-01-02T23:39:06.645ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37752 req_id = 71c6a74a-ec4e-4063-820c-1ab91d877a35 response_code = 204 uri = /eip-gateways
23752025-01-02T23:39:06.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37752 req_id = d848af24-1a7b-479c-a9ce-598e22513269 response_code = 204 uri = /vpc-routes
23762025-01-02T23:39:06.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49750
23772025-01-02T23:39:06.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49750 req_id = 559111df-26d3-4503-95a5-17467446e74c response_code = 200 uri = /v2p
23782025-01-02T23:39:06.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43155
23792025-01-02T23:39:06.931ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
23802025-01-02T23:39:06.972ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
23812025-01-02T23:39:07.042ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111197 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43155 req_id = 1390e624-13e8-4acf-a015-516ceb36859f response_code = 204 uri = /switch-ports
23822025-01-02T23:39:07.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43155 req_id = 06643cc0-666c-4b46-a7d8-3c0e86198034 response_code = 200 uri = /network-bootstore-config
23832025-01-02T23:39:07.050ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37712
23842025-01-02T23:39:07.050ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
23852025-01-02T23:39:07.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23862025-01-02T23:39:07.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23872025-01-02T23:39:07.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23882025-01-02T23:39:07.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
23892025-01-02T23:39:07.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
23902025-01-02T23:39:07.050ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
23912025-01-02T23:39:07.050ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 393 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37712 req_id = 47f3ba04-80e2-4cd8-aa52-adf17241feb0 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
23922025-01-02T23:39:07.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58145
23932025-01-02T23:39:07.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58145 req_id = 330b5010-2737-4ef9-88cc-dcfcb1427c78 response_code = 200 uri = /vpc-routes
23942025-01-02T23:39:07.125ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
23952025-01-02T23:39:07.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58145 req_id = a79cd6d5-0a2b-4d60-9969-02dbf26d939a response_code = 204 uri = /eip-gateways
23962025-01-02T23:39:07.220ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34686
23972025-01-02T23:39:07.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34686 req_id = 8b237f9d-149d-44a8-8e48-80fad5dc3694 response_code = 200 uri = /v2p
23982025-01-02T23:39:07.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58145 req_id = 491bf06e-5f6a-47e9-9301-4665fae1fc17 response_code = 204 uri = /vpc-routes
23992025-01-02T23:39:07.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39286
24002025-01-02T23:39:07.300ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24012025-01-02T23:39:07.300ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24022025-01-02T23:39:07.300ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24032025-01-02T23:39:07.300ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24042025-01-02T23:39:07.300ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
24052025-01-02T23:39:07.300ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24062025-01-02T23:39:07.300ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24072025-01-02T23:39:07.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39286 req_id = 26898074-3034-4aa7-879e-b0784d6e467e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
24082025-01-02T23:39:07.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42476
24092025-01-02T23:39:07.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24102025-01-02T23:39:07.389ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24112025-01-02T23:39:07.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89413 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42476 req_id = 46556556-430c-4204-95df-297867588a83 response_code = 204 uri = /switch-ports
24122025-01-02T23:39:07.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42476 req_id = b555ce24-ed4d-4fb5-87e4-890f98ac8a5c response_code = 200 uri = /network-bootstore-config
24132025-01-02T23:39:28.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8362 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = ff9b09fe-131a-4f93-a6ff-9c2ac702c81c response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
24142025-01-02T23:39:29.718ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43293
24152025-01-02T23:39:29.718ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 29 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:43293 req_id = d81d2a46-b995-4f1c-b537-9abd89515917 response_code = 200 uri = /baseboard
24162025-01-02T23:39:34.606ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39245
24172025-01-02T23:39:34.606ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39245 req_id = 156a1515-648b-4510-977b-a4cf74dfd568 response_code = 200 uri = /vpc-routes
24182025-01-02T23:39:34.646ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
24192025-01-02T23:39:34.646ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39245 req_id = 47c73b83-ca6b-4616-b3e6-1b6aaa2f19a0 response_code = 204 uri = /eip-gateways
24202025-01-02T23:39:34.655ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 207 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39245 req_id = bb4b6ba8-2bd4-43b6-acf3-6f139a0392f2 response_code = 204 uri = /vpc-routes
24212025-01-02T23:39:34.725ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38547
24222025-01-02T23:39:34.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38547 req_id = 1bcadb3e-384c-4bf6-86b4-06070f679bd4 response_code = 200 uri = /v2p
24232025-01-02T23:39:34.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38424
24242025-01-02T23:39:34.745ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24252025-01-02T23:39:34.781ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24262025-01-02T23:39:34.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88184 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38424 req_id = 28c75928-f370-4762-9968-8b6bf24ca215 response_code = 204 uri = /switch-ports
24272025-01-02T23:39:34.834ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38424 req_id = f9f96cb1-eb6b-4496-a317-1f72e10d0024 response_code = 200 uri = /network-bootstore-config
24282025-01-02T23:39:35.651ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
24292025-01-02T23:39:35.651ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
24302025-01-02T23:39:35.679ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1897, tv_nsec: 6483905 } time_to_next_cleanup = 599.999995669s
24312025-01-02T23:39:36.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33759
24322025-01-02T23:39:36.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33759 req_id = cb5442a1-e699-42d0-b2ad-a0b36a87e25d response_code = 200 uri = /vpc-routes
24332025-01-02T23:39:36.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52546
24342025-01-02T23:39:36.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52546 req_id = 9b80647c-fd3a-4fdf-b61b-65690b41d2da response_code = 200 uri = /v2p
24352025-01-02T23:39:36.731ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
24362025-01-02T23:39:36.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33759 req_id = 0d99a176-5e7b-432e-817e-5abf2dc26f17 response_code = 204 uri = /eip-gateways
24372025-01-02T23:39:36.740ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33759 req_id = 60534e87-9d6f-471f-88c3-10b3aa0c39bd response_code = 204 uri = /vpc-routes
24382025-01-02T23:39:36.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62314
24392025-01-02T23:39:36.755ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24402025-01-02T23:39:36.807ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24412025-01-02T23:39:36.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130078 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:62314 req_id = e5dc39da-f455-490d-b5fd-519ae043e364 response_code = 204 uri = /switch-ports
24422025-01-02T23:39:36.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62314 req_id = 793e07a0-845b-433c-b061-ff0cdc09ea95 response_code = 200 uri = /network-bootstore-config
24432025-01-02T23:39:36.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43091
24442025-01-02T23:39:36.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43091 req_id = a6072e9b-2fd0-472d-8e48-b837df4304a1 response_code = 200 uri = /vpc-routes
24452025-01-02T23:39:36.971ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
24462025-01-02T23:39:36.971ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43091 req_id = 0dbb2e25-35f0-4bbf-802f-1ced7bdedff7 response_code = 204 uri = /eip-gateways
24472025-01-02T23:39:37.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33163
24482025-01-02T23:39:37.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33163 req_id = 566251d5-c5d8-4aa0-be69-feb23ca5fbef response_code = 200 uri = /v2p
24492025-01-02T23:39:37.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43091 req_id = 32f30be5-fd06-4d72-bf30-d141d5af34f1 response_code = 204 uri = /vpc-routes
24502025-01-02T23:39:37.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44399
24512025-01-02T23:39:37.030ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24522025-01-02T23:39:37.065ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24532025-01-02T23:39:37.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91837 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44399 req_id = 95e1aa72-d58b-49ef-9e64-5ce856a1fb25 response_code = 204 uri = /switch-ports
24542025-01-02T23:39:37.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44399 req_id = 59d6adb7-6784-4c92-872b-263cbbbfb26a response_code = 200 uri = /network-bootstore-config
24552025-01-02T23:39:50.806ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
24562025-01-02T23:39:58.832ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6621 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = f63d6657-e369-4c10-a8b9-95846c25ea37 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
24572025-01-02T23:39:59.751ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40323
24582025-01-02T23:39:59.752ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40323 req_id = 54bc2b25-d36f-41d5-a7a4-b48d04df62d5 response_code = 200 uri = /baseboard
24592025-01-02T23:40:04.650ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34386
24602025-01-02T23:40:04.650ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34386 req_id = cd03a2ab-9cb2-4b52-9252-c2991ad7d778 response_code = 200 uri = /vpc-routes
24612025-01-02T23:40:04.698ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
24622025-01-02T23:40:04.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34386 req_id = d08ff47e-7076-4089-8a05-cd6ada58e660 response_code = 204 uri = /eip-gateways
24632025-01-02T23:40:04.708ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34386 req_id = 95fe2b6d-2a67-47e1-99a6-00867e1a1e7f response_code = 204 uri = /vpc-routes
24642025-01-02T23:40:04.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53313
24652025-01-02T23:40:04.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53313 req_id = 158918c1-9bf4-43a5-ad3f-2b34f35c3b73 response_code = 200 uri = /v2p
24662025-01-02T23:40:05.048ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56149
24672025-01-02T23:40:05.049ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24682025-01-02T23:40:05.082ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24692025-01-02T23:40:05.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83506 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56149 req_id = aab99660-245c-45a8-851b-414e32fcf6e7 response_code = 204 uri = /switch-ports
24702025-01-02T23:40:05.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56149 req_id = e1fd1e6c-a433-423a-a4e6-61674ed4e6f7 response_code = 200 uri = /network-bootstore-config
24712025-01-02T23:40:06.874ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36362
24722025-01-02T23:40:06.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36362 req_id = 48c8858a-4ccb-48b0-a794-6e80f49391c8 response_code = 200 uri = /vpc-routes
24732025-01-02T23:40:06.932ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
24742025-01-02T23:40:06.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36362 req_id = a91cdeb3-7751-48a1-889c-0fe9dd878bc9 response_code = 204 uri = /eip-gateways
24752025-01-02T23:40:06.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56915
24762025-01-02T23:40:06.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56915 req_id = 73883053-1963-411d-901d-081ff69be1bf response_code = 200 uri = /v2p
24772025-01-02T23:40:06.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36362 req_id = 332dba60-fac9-4db7-a301-972cdc27d30a response_code = 204 uri = /vpc-routes
24782025-01-02T23:40:06.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57333
24792025-01-02T23:40:06.991ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24802025-01-02T23:40:07.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24812025-01-02T23:40:07.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93088 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57333 req_id = 3d4a59bd-1eb2-4d8f-9837-d7d50b5f5fe6 response_code = 204 uri = /switch-ports
24822025-01-02T23:40:07.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57333 req_id = f9d559cb-17ff-49eb-8274-33160124baba response_code = 200 uri = /network-bootstore-config
24832025-01-02T23:40:07.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34975
24842025-01-02T23:40:07.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34975 req_id = 6754b6d2-c5a1-4761-acd9-9405131c3ab6 response_code = 200 uri = /vpc-routes
24852025-01-02T23:40:07.171ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
24862025-01-02T23:40:07.171ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34975 req_id = d9873730-4091-4ce5-902b-2875813cae90 response_code = 204 uri = /eip-gateways
24872025-01-02T23:40:07.181ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 326 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34975 req_id = b968be46-50f6-4b8f-a6e7-e0c3cefebffa response_code = 204 uri = /vpc-routes
24882025-01-02T23:40:07.373ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60925
24892025-01-02T23:40:07.373ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60925 req_id = 748717c9-a1b5-4f4c-8868-607c9a9f4c88 response_code = 200 uri = /v2p
24902025-01-02T23:40:07.428ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39750
24912025-01-02T23:40:07.428ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
24922025-01-02T23:40:07.466ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
24932025-01-02T23:40:07.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91898 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39750 req_id = 5c36efa1-15ce-4d68-84b6-a539e2a3bb48 response_code = 204 uri = /switch-ports
24942025-01-02T23:40:07.529ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39750 req_id = 6a76edbe-a352-42c7-933b-5a4fd6a7cc2e response_code = 200 uri = /network-bootstore-config
24952025-01-02T23:40:28.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6795 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = fdf8abb4-dc2e-41ab-9009-01624c6773a2 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
24962025-01-02T23:40:29.786ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53946
24972025-01-02T23:40:29.786ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53946 req_id = 68952db9-1be7-489c-9748-84607033966f response_code = 200 uri = /baseboard
24982025-01-02T23:40:34.633ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59873
24992025-01-02T23:40:34.633ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59873 req_id = 75cd4efb-cab4-43b2-bee2-beeb6fe6b61b response_code = 200 uri = /vpc-routes
25002025-01-02T23:40:34.647ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
25012025-01-02T23:40:34.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59873 req_id = 115df216-b17e-4055-9043-c9b48ac4d0a3 response_code = 204 uri = /eip-gateways
25022025-01-02T23:40:34.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59873 req_id = bca7c5ef-6bb0-4625-89db-337e08652eee response_code = 204 uri = /vpc-routes
25032025-01-02T23:40:34.701ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62414
25042025-01-02T23:40:34.701ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62414 req_id = 79586a34-2990-4a85-a4bd-d1390f5682dc response_code = 200 uri = /v2p
25052025-01-02T23:40:34.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56217
25062025-01-02T23:40:34.789ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25072025-01-02T23:40:34.825ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25082025-01-02T23:40:34.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90577 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56217 req_id = 7cb596d1-bb77-47f4-bf52-3f5013f4328d response_code = 204 uri = /switch-ports
25092025-01-02T23:40:34.879ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56217 req_id = 952f9bc2-26c6-443d-8ff2-d257727475bf response_code = 200 uri = /network-bootstore-config
25102025-01-02T23:40:36.565ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59733
25112025-01-02T23:40:36.565ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59733 req_id = 400ce34e-f3f8-4db1-97c5-0a938cc79991 response_code = 200 uri = /vpc-routes
25122025-01-02T23:40:36.582ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
25132025-01-02T23:40:36.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59733 req_id = 73fc08df-4132-4160-a9e1-c13cb78901be response_code = 204 uri = /eip-gateways
25142025-01-02T23:40:36.713ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53834
25152025-01-02T23:40:36.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53834 req_id = 7fe66481-6fca-49a4-a244-29c2c00e7694 response_code = 200 uri = /v2p
25162025-01-02T23:40:36.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59733 req_id = 87df7e01-3886-4ead-a585-2849547d027c response_code = 204 uri = /vpc-routes
25172025-01-02T23:40:36.837ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55811
25182025-01-02T23:40:36.837ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25192025-01-02T23:40:36.882ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25202025-01-02T23:40:36.945ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108225 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:55811 req_id = 27f0f235-5347-47d1-8907-43c79d3faffb response_code = 204 uri = /switch-ports
25212025-01-02T23:40:36.946ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55811 req_id = 34439e8a-650a-4ba2-8101-385ca979f7b4 response_code = 200 uri = /network-bootstore-config
25222025-01-02T23:40:36.972ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48599
25232025-01-02T23:40:36.972ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48599 req_id = dcc26280-c567-4e89-8649-7baf70410ec9 response_code = 200 uri = /vpc-routes
25242025-01-02T23:40:37.024ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
25252025-01-02T23:40:37.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48599 req_id = 252b1452-b5a8-48de-918b-49fd8c6a7242 response_code = 204 uri = /eip-gateways
25262025-01-02T23:40:37.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48599 req_id = 52c44fed-bee7-40ce-8655-3f78c6863bd0 response_code = 204 uri = /vpc-routes
25272025-01-02T23:40:37.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44775
25282025-01-02T23:40:37.056ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25292025-01-02T23:40:37.095ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25302025-01-02T23:40:37.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103961 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44775 req_id = 3e759f3a-223b-41b4-9ae4-d2d8649eb122 response_code = 204 uri = /switch-ports
25312025-01-02T23:40:37.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42655
25322025-01-02T23:40:37.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42655 req_id = 35cca31b-b915-4036-8305-d97ef57e7c7e response_code = 200 uri = /v2p
25332025-01-02T23:40:37.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44775 req_id = 96d97f88-a606-4472-91a3-13e5ae49dc5f response_code = 200 uri = /network-bootstore-config
25342025-01-02T23:40:58.833ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6717 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 545ac44f-2d31-42c6-9d18-e4b7e33f3c1f response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
25352025-01-02T23:40:59.820ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54588
25362025-01-02T23:40:59.820ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:54588 req_id = f0e3349e-dfd6-4bf3-91c2-a76e3f82889f response_code = 200 uri = /baseboard
25372025-01-02T23:41:04.707ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60669
25382025-01-02T23:41:04.707ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60669 req_id = 7da71e11-3f31-4f45-b75b-262fad41ce8d response_code = 200 uri = /vpc-routes
25392025-01-02T23:41:04.747ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
25402025-01-02T23:41:04.747ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60669 req_id = 39f3c8ec-650c-469d-8363-66fa4f0491da response_code = 204 uri = /eip-gateways
25412025-01-02T23:41:04.757ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 246 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60669 req_id = 6c9a5c53-5b64-4905-a217-52c71f65d9bb response_code = 204 uri = /vpc-routes
25422025-01-02T23:41:04.848ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52022
25432025-01-02T23:41:04.848ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52022 req_id = a0945553-ab59-4bfb-a74b-fe1b9012b096 response_code = 200 uri = /v2p
25442025-01-02T23:41:04.850ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63380
25452025-01-02T23:41:04.850ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25462025-01-02T23:41:04.888ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25472025-01-02T23:41:04.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89054 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63380 req_id = dd8334d5-a633-4f68-90f4-a1c0cfea38d7 response_code = 204 uri = /switch-ports
25482025-01-02T23:41:04.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63380 req_id = 803bf3f8-0070-4b28-bd60-02e82bbbcce9 response_code = 200 uri = /network-bootstore-config
25492025-01-02T23:41:06.892ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51842
25502025-01-02T23:41:06.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51842 req_id = af90ae0e-5bcf-4ac5-9911-9e69749b4c1b response_code = 200 uri = /vpc-routes
25512025-01-02T23:41:06.954ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
25522025-01-02T23:41:06.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51842 req_id = 8467f20d-402f-47a9-b4f2-5288c78d4a58 response_code = 204 uri = /eip-gateways
25532025-01-02T23:41:06.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51842 req_id = aa25b997-cc8f-4ace-a24a-7ae181430131 response_code = 204 uri = /vpc-routes
25542025-01-02T23:41:07.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54317
25552025-01-02T23:41:07.057ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25562025-01-02T23:41:07.095ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25572025-01-02T23:41:07.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89433 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54317 req_id = ffced439-3217-4610-a8f3-5d41a58b24d2 response_code = 204 uri = /switch-ports
25582025-01-02T23:41:07.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43780
25592025-01-02T23:41:07.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47476
25602025-01-02T23:41:07.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47476 req_id = f35e528f-799f-48d7-a92c-ad04da4c94ca response_code = 200 uri = /v2p
25612025-01-02T23:41:07.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43780 req_id = 275ce6b9-2da1-412b-a375-dc9c9546ceed response_code = 200 uri = /vpc-routes
25622025-01-02T23:41:07.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54317 req_id = d3f13e14-e8d8-478c-b815-c01b23f8b6df response_code = 200 uri = /network-bootstore-config
25632025-01-02T23:41:07.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39606
25642025-01-02T23:41:07.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39606 req_id = 5b90a25e-0aa9-4730-a050-46192d8656b5 response_code = 200 uri = /v2p
25652025-01-02T23:41:07.202ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
25662025-01-02T23:41:07.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43780 req_id = 9cb51987-3e62-42b4-b960-59235f2b5c8f response_code = 204 uri = /eip-gateways
25672025-01-02T23:41:07.211ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43780 req_id = 66ea0275-56a6-40b8-ae95-6f6f28dc60ce response_code = 204 uri = /vpc-routes
25682025-01-02T23:41:07.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57990
25692025-01-02T23:41:07.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25702025-01-02T23:41:07.341ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25712025-01-02T23:41:07.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81883 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57990 req_id = 87097c28-e5d5-4ae6-9095-371d9bb00f21 response_code = 204 uri = /switch-ports
25722025-01-02T23:41:07.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57990 req_id = 0ffac051-d5b7-4c5e-85b2-6bccb3ab92c0 response_code = 200 uri = /network-bootstore-config
25732025-01-02T23:41:28.834ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7336 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 0d3a84e3-a91f-42ad-9502-33c10ae76d89 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
25742025-01-02T23:41:29.854ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64906
25752025-01-02T23:41:29.854ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:64906 req_id = fe720749-b91b-4577-8a85-ec3f556982bd response_code = 200 uri = /baseboard
25762025-01-02T23:41:34.615ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50546
25772025-01-02T23:41:34.615ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50546 req_id = 33a01ade-b3d7-479b-9c6b-d1c9b9e3f203 response_code = 200 uri = /vpc-routes
25782025-01-02T23:41:34.629ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
25792025-01-02T23:41:34.629ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50546 req_id = 318dbbce-d747-4ca5-bb68-12035bf62381 response_code = 204 uri = /eip-gateways
25802025-01-02T23:41:34.677ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37275
25812025-01-02T23:41:34.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37275 req_id = 18c30985-8f0e-44ff-a63c-b0c4f117629a response_code = 200 uri = /v2p
25822025-01-02T23:41:34.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50546 req_id = dca6b18c-5e17-4636-b484-598f4335f95f response_code = 204 uri = /vpc-routes
25832025-01-02T23:41:34.719ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59618
25842025-01-02T23:41:34.719ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25852025-01-02T23:41:34.757ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25862025-01-02T23:41:34.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90742 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59618 req_id = f3a7e149-6eea-4fcf-b108-5eea381db2f5 response_code = 204 uri = /switch-ports
25872025-01-02T23:41:34.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59618 req_id = 71dc2cb2-d16f-40bf-889b-8d19df945680 response_code = 200 uri = /network-bootstore-config
25882025-01-02T23:41:36.669ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54233
25892025-01-02T23:41:36.669ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54233 req_id = 73c61844-8a56-41e7-87ef-170e21bf2a4b response_code = 200 uri = /vpc-routes
25902025-01-02T23:41:36.749ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56981
25912025-01-02T23:41:36.749ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56981 req_id = ec051cc5-05be-4b43-b158-143d6465a886 response_code = 200 uri = /v2p
25922025-01-02T23:41:36.806ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
25932025-01-02T23:41:36.806ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54233 req_id = f7cdb7f4-6d7e-4705-abfe-82f03d31c3d2 response_code = 204 uri = /eip-gateways
25942025-01-02T23:41:36.814ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54233 req_id = 714328c4-5ff7-4220-a256-53a7e5458cb0 response_code = 204 uri = /vpc-routes
25952025-01-02T23:41:36.841ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43656
25962025-01-02T23:41:36.842ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
25972025-01-02T23:41:36.879ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
25982025-01-02T23:41:36.941ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43656 req_id = 849b49de-bc3d-4369-af5a-ff8a51a74c10 response_code = 204 uri = /switch-ports
25992025-01-02T23:41:36.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45118
26002025-01-02T23:41:36.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 273 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43656 req_id = 81ec9112-d962-4b2f-9397-59b5aa16857f response_code = 200 uri = /network-bootstore-config
26012025-01-02T23:41:36.942ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45118 req_id = 383d5410-8842-45b5-b9fb-c3498a42d0b5 response_code = 200 uri = /vpc-routes
26022025-01-02T23:41:37.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40144
26032025-01-02T23:41:37.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40144 req_id = 29ffabb7-4073-4c42-a12a-0266474646b5 response_code = 200 uri = /v2p
26042025-01-02T23:41:37.123ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
26052025-01-02T23:41:37.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45118 req_id = c3398a5d-721e-4574-9de2-0a4950d24aff response_code = 204 uri = /eip-gateways
26062025-01-02T23:41:37.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45118 req_id = ed375c3d-eee0-4faa-af0f-c248e7faaf5e response_code = 204 uri = /vpc-routes
26072025-01-02T23:41:37.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51309
26082025-01-02T23:41:37.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26092025-01-02T23:41:37.223ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26102025-01-02T23:41:37.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98305 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51309 req_id = 77d50937-19d1-4b1d-af12-2ef371ed5a51 response_code = 204 uri = /switch-ports
26112025-01-02T23:41:37.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51309 req_id = fac94fc3-5cca-4897-8c9d-ea99cbf24817 response_code = 200 uri = /network-bootstore-config
26122025-01-02T23:41:58.834ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6919 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = db8d727c-aac1-41d1-b41b-c7baff5779d8 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
26132025-01-02T23:41:59.888ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65267
26142025-01-02T23:41:59.888ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:65267 req_id = 6082c427-8936-445e-ab35-fe44a10ce18b response_code = 200 uri = /baseboard
26152025-01-02T23:42:04.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45963
26162025-01-02T23:42:04.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45963 req_id = d4d031d0-a1b1-490d-baad-fd483562698b response_code = 200 uri = /v2p
26172025-01-02T23:42:04.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50890
26182025-01-02T23:42:04.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50890 req_id = b9d03d55-19be-4088-8f14-6961362ea1a2 response_code = 200 uri = /vpc-routes
26192025-01-02T23:42:04.830ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
26202025-01-02T23:42:04.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50890 req_id = f66f2efe-a438-4c31-b186-2c2beaab5ab5 response_code = 204 uri = /eip-gateways
26212025-01-02T23:42:04.840ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:50890 req_id = c5cb5b73-5766-45f9-a760-03b58d52341e response_code = 204 uri = /vpc-routes
26222025-01-02T23:42:04.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43423
26232025-01-02T23:42:04.932ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26242025-01-02T23:42:04.969ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26252025-01-02T23:42:05.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92541 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43423 req_id = 710842fc-eea5-4598-8d38-a3ce7a8384f8 response_code = 204 uri = /switch-ports
26262025-01-02T23:42:05.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43423 req_id = 3172635b-064e-4406-8c86-dd857f0c9455 response_code = 200 uri = /network-bootstore-config
26272025-01-02T23:42:06.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62199
26282025-01-02T23:42:06.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62199 req_id = d24adc9f-d2b4-4dcd-b948-3d10f72e2dd1 response_code = 200 uri = /vpc-routes
26292025-01-02T23:42:06.809ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
26302025-01-02T23:42:06.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62199 req_id = ac4a4633-a598-474e-825f-6750035482c2 response_code = 204 uri = /eip-gateways
26312025-01-02T23:42:06.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 383 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62199 req_id = d5c058f7-7ef0-40ef-852b-e56cc0315cbc response_code = 204 uri = /vpc-routes
26322025-01-02T23:42:06.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45585
26332025-01-02T23:42:06.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45585 req_id = f56bb61a-5164-464e-beaa-e124f26f34eb response_code = 200 uri = /v2p
26342025-01-02T23:42:06.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41848
26352025-01-02T23:42:06.971ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26362025-01-02T23:42:07.006ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26372025-01-02T23:42:07.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90373 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41848 req_id = b101d79b-7454-4da4-9fb6-065a06014114 response_code = 204 uri = /switch-ports
26382025-01-02T23:42:07.062ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51737
26392025-01-02T23:42:07.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51737 req_id = f4d91092-2f6b-4769-86cb-ef87ed7324d2 response_code = 200 uri = /vpc-routes
26402025-01-02T23:42:07.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41848 req_id = 49a24515-ac7e-49b6-a6ec-12c3cb8a5c77 response_code = 200 uri = /network-bootstore-config
26412025-01-02T23:42:07.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
26422025-01-02T23:42:07.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51737 req_id = a1fa6db1-2fa0-4367-92dc-9469bc7fa887 response_code = 204 uri = /eip-gateways
26432025-01-02T23:42:07.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40649
26442025-01-02T23:42:07.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40649 req_id = f666bbdf-403f-47bc-8457-c256625e9708 response_code = 200 uri = /v2p
26452025-01-02T23:42:07.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51737 req_id = 68e83383-ed0d-48e0-a87e-ccfecd707836 response_code = 204 uri = /vpc-routes
26462025-01-02T23:42:07.272ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57423
26472025-01-02T23:42:07.272ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26482025-01-02T23:42:07.304ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26492025-01-02T23:42:07.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88918 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57423 req_id = b2be73ad-2fdd-4221-a8bb-29a2e157ae3b response_code = 204 uri = /switch-ports
26502025-01-02T23:42:07.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57423 req_id = 1c8456e8-cbdd-45aa-9d86-e9f31a6dec6f response_code = 200 uri = /network-bootstore-config
26512025-01-02T23:42:28.834ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6277 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = a97736d9-4d02-47bf-8b8e-5f993cc8b8d2 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
26522025-01-02T23:42:29.922ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51897
26532025-01-02T23:42:29.923ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:51897 req_id = 549fc340-16db-4555-9426-6e4a9e447931 response_code = 200 uri = /baseboard
26542025-01-02T23:42:34.668ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54084
26552025-01-02T23:42:34.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54084 req_id = 2fc439f6-049c-446f-9380-360ae7e6e68c response_code = 200 uri = /vpc-routes
26562025-01-02T23:42:34.682ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
26572025-01-02T23:42:34.682ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54084 req_id = c6179c98-239b-48c5-9881-4a2c58a7b3a0 response_code = 204 uri = /eip-gateways
26582025-01-02T23:42:34.691ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 223 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54084 req_id = faf740cb-a227-47a6-9ae0-d88159dfccc3 response_code = 204 uri = /vpc-routes
26592025-01-02T23:42:34.751ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32991
26602025-01-02T23:42:34.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32991 req_id = 1766a03c-16bb-4462-98ff-21bda851fa8f response_code = 200 uri = /v2p
26612025-01-02T23:42:34.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59989
26622025-01-02T23:42:34.791ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26632025-01-02T23:42:34.826ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26642025-01-02T23:42:34.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86525 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:59989 req_id = b7aa3bfc-92c1-4b09-b76b-8ba83ae4fd18 response_code = 204 uri = /switch-ports
26652025-01-02T23:42:34.878ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59989 req_id = f8826839-ef1e-4275-83f1-f098275f49ac response_code = 200 uri = /network-bootstore-config
26662025-01-02T23:42:36.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35629
26672025-01-02T23:42:36.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35629 req_id = ae276591-0a41-44db-b1c8-7792d7557314 response_code = 200 uri = /vpc-routes
26682025-01-02T23:42:36.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
26692025-01-02T23:42:36.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35629 req_id = 2dd2fc33-51c9-45e2-ba8c-a5ad83e0ae16 response_code = 204 uri = /eip-gateways
26702025-01-02T23:42:36.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35629 req_id = 8d529ab5-9939-4b89-b15d-d81262a200ff response_code = 204 uri = /vpc-routes
26712025-01-02T23:42:36.872ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41469
26722025-01-02T23:42:36.873ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26732025-01-02T23:42:36.917ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26742025-01-02T23:42:36.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103388 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41469 req_id = 18d93728-78b7-4b4f-92f8-e687b9989a09 response_code = 204 uri = /switch-ports
26752025-01-02T23:42:36.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49498
26762025-01-02T23:42:36.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41469 req_id = e0e20e1c-c683-4c32-8a33-8289ff0c2b9b response_code = 200 uri = /network-bootstore-config
26772025-01-02T23:42:36.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49498 req_id = a6c071df-8816-42ff-be37-5e0c48d706f4 response_code = 200 uri = /v2p
26782025-01-02T23:42:37.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58612
26792025-01-02T23:42:37.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58612 req_id = 6f474a61-db73-4e99-98de-9e0f8ef3b765 response_code = 200 uri = /vpc-routes
26802025-01-02T23:42:37.045ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
26812025-01-02T23:42:37.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58612 req_id = 9e1f7937-8af8-40d2-b096-9f96c69f5c2e response_code = 204 uri = /eip-gateways
26822025-01-02T23:42:37.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54041
26832025-01-02T23:42:37.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54041 req_id = 44c22af9-73e4-4bd9-8cec-e339ecfc969d response_code = 200 uri = /v2p
26842025-01-02T23:42:37.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58612 req_id = 3eb39b9c-a866-4f33-b34b-32ceea09bd48 response_code = 204 uri = /vpc-routes
26852025-01-02T23:42:37.096ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59278
26862025-01-02T23:42:37.097ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
26872025-01-02T23:42:37.137ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
26882025-01-02T23:42:37.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98178 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59278 req_id = fa04182e-38bc-4d00-9a63-666be6e0ebad response_code = 204 uri = /switch-ports
26892025-01-02T23:42:37.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59278 req_id = f3a3f575-4181-4146-a8f9-0e42257cbb8f response_code = 200 uri = /network-bootstore-config
26902025-01-02T23:42:58.834ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6781 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = b8926bed-e923-4b92-a52a-9602bfb3d7e7 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
26912025-01-02T23:42:59.956ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44681
26922025-01-02T23:42:59.956ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:44681 req_id = e5899a5a-5b0b-4e9f-a2f1-eb4db91013a3 response_code = 200 uri = /baseboard
26932025-01-02T23:43:04.736ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36867
26942025-01-02T23:43:04.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36867 req_id = 87ec9893-1787-4aaa-a91f-c8f70cba07e6 response_code = 200 uri = /v2p
26952025-01-02T23:43:04.907ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48846
26962025-01-02T23:43:04.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48846 req_id = e7c0d2d0-a1bf-4010-b565-5c417abcc5a1 response_code = 200 uri = /vpc-routes
26972025-01-02T23:43:04.921ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
26982025-01-02T23:43:04.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48846 req_id = 364410cc-e3f3-4577-8854-82d1c2e5f4bb response_code = 204 uri = /eip-gateways
26992025-01-02T23:43:04.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48846 req_id = b49e3ccd-5733-418c-96a8-b839d2889ef1 response_code = 204 uri = /vpc-routes
27002025-01-02T23:43:05.046ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51373
27012025-01-02T23:43:05.046ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27022025-01-02T23:43:05.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27032025-01-02T23:43:05.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51373 req_id = d28dc8a6-ab88-407c-bbed-4e17f6d54a7f response_code = 204 uri = /switch-ports
27042025-01-02T23:43:05.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51373 req_id = 60b53809-6175-4d4d-8273-15d5265c6864 response_code = 200 uri = /network-bootstore-config
27052025-01-02T23:43:06.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33571
27062025-01-02T23:43:06.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33571 req_id = a2bf8de8-4ca5-42a6-99f9-b6532208f468 response_code = 200 uri = /vpc-routes
27072025-01-02T23:43:06.886ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
27082025-01-02T23:43:06.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33571 req_id = 6b2ba1ce-2eac-427e-b211-2ba91996b182 response_code = 204 uri = /eip-gateways
27092025-01-02T23:43:06.960ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33812
27102025-01-02T23:43:06.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33812 req_id = b2d1fb09-dfc9-4f30-bf45-66bb6bde8095 response_code = 200 uri = /v2p
27112025-01-02T23:43:06.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33571 req_id = be99a90e-4b8e-4af2-89ee-f0ee1e8b23ef response_code = 204 uri = /vpc-routes
27122025-01-02T23:43:07.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58218
27132025-01-02T23:43:07.004ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27142025-01-02T23:43:07.043ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27152025-01-02T23:43:07.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91276 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58218 req_id = d26d04b0-05dd-40b1-a01b-26d3df339404 response_code = 204 uri = /switch-ports
27162025-01-02T23:43:07.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58218 req_id = f1ce43fd-3b7c-4ac8-a335-8c4e2f6c33b9 response_code = 200 uri = /network-bootstore-config
27172025-01-02T23:43:07.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35433
27182025-01-02T23:43:07.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35433 req_id = 14ed9295-7bad-4ad2-a931-630239cd47a0 response_code = 200 uri = /vpc-routes
27192025-01-02T23:43:07.185ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
27202025-01-02T23:43:07.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35433 req_id = d6a6e064-f5b2-4dab-b1ef-110dfaed6171 response_code = 204 uri = /eip-gateways
27212025-01-02T23:43:07.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45522
27222025-01-02T23:43:07.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45522 req_id = 0cc3294d-e03b-4a13-938e-3eb849923b14 response_code = 200 uri = /v2p
27232025-01-02T23:43:07.262ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35433 req_id = 58eeef36-960b-488c-aa92-421cb0bd59f9 response_code = 204 uri = /vpc-routes
27242025-01-02T23:43:07.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44527
27252025-01-02T23:43:07.375ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27262025-01-02T23:43:07.410ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27272025-01-02T23:43:07.464ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89046 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:44527 req_id = b6340de0-53c2-4f6d-a23d-1623b191eadc response_code = 204 uri = /switch-ports
27282025-01-02T23:43:07.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44527 req_id = f79dc1db-33a5-4020-a7d2-dde9b7fde569 response_code = 200 uri = /network-bootstore-config
27292025-01-02T23:43:28.835ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6479 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = 0bceff4d-919c-4795-9a79-116648b65e20 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
27302025-01-02T23:43:29.991ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40646
27312025-01-02T23:43:29.991ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:40646 req_id = 0d38185b-4390-4951-94ef-429b9a20a933 response_code = 200 uri = /baseboard
27322025-01-02T23:43:34.604ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47872
27332025-01-02T23:43:34.604ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 172 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47872 req_id = 78cb0096-828e-44c8-b57c-ce105a1c7ff8 response_code = 200 uri = /v2p
27342025-01-02T23:43:34.686ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40781
27352025-01-02T23:43:34.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40781 req_id = c2bc405b-3648-408e-a675-33a726588306 response_code = 200 uri = /vpc-routes
27362025-01-02T23:43:34.726ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
27372025-01-02T23:43:34.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40781 req_id = d41b5187-fb7e-4035-b502-a43eb4640919 response_code = 204 uri = /eip-gateways
27382025-01-02T23:43:34.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:40781 req_id = c7b7dda0-2f5f-4530-baf5-0d2598648d73 response_code = 204 uri = /vpc-routes
27392025-01-02T23:43:34.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44361
27402025-01-02T23:43:34.775ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27412025-01-02T23:43:34.809ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27422025-01-02T23:43:34.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84058 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44361 req_id = ab248edb-ee69-4bce-a44a-7193e3dc2bd1 response_code = 204 uri = /switch-ports
27432025-01-02T23:43:34.859ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44361 req_id = 8208fc20-2d87-438e-8369-76b6be94351a response_code = 200 uri = /network-bootstore-config
27442025-01-02T23:43:36.649ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35252
27452025-01-02T23:43:36.649ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35252 req_id = 9f12bc08-2da8-4a2c-8dd0-6c4b0c51be40 response_code = 200 uri = /vpc-routes
27462025-01-02T23:43:36.688ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
27472025-01-02T23:43:36.688ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35252 req_id = 10d50560-01c7-487f-ac2b-ada9d23c8f66 response_code = 204 uri = /eip-gateways
27482025-01-02T23:43:36.697ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35252 req_id = da1fcfa3-0bbf-4515-97f7-c78a2cbf0c3e response_code = 204 uri = /vpc-routes
27492025-01-02T23:43:36.733ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34914
27502025-01-02T23:43:36.733ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27512025-01-02T23:43:36.774ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27522025-01-02T23:43:36.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126675 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34914 req_id = 96a18b82-91db-4ec5-a64a-e43637f2b79d response_code = 204 uri = /switch-ports
27532025-01-02T23:43:36.860ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43315
27542025-01-02T23:43:36.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43315 req_id = b91c6f43-469c-4848-8430-57217ab0193b response_code = 200 uri = /v2p
27552025-01-02T23:43:36.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 234 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34914 req_id = 7a4a2cc1-887a-4566-8793-13850d486205 response_code = 200 uri = /network-bootstore-config
27562025-01-02T23:43:37.105ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55841
27572025-01-02T23:43:37.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55841 req_id = 2a7e61d8-aad6-4db8-812a-fa326e8e6f2d response_code = 200 uri = /vpc-routes
27582025-01-02T23:43:37.153ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
27592025-01-02T23:43:37.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55841 req_id = f92a0c93-6cc5-4fb3-9d36-2a51d974c554 response_code = 204 uri = /eip-gateways
27602025-01-02T23:43:37.161ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55841 req_id = 195303d4-d4fb-46ba-97a5-2e305c005054 response_code = 204 uri = /vpc-routes
27612025-01-02T23:43:37.167ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36869
27622025-01-02T23:43:37.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36869 req_id = d932d8f6-fa4f-4a2b-bb57-b310737e73ea response_code = 200 uri = /v2p
27632025-01-02T23:43:37.211ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62192
27642025-01-02T23:43:37.211ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27652025-01-02T23:43:37.249ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27662025-01-02T23:43:37.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93434 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:62192 req_id = 7c59dc05-4556-406b-bb8b-8e771fcd4fff response_code = 204 uri = /switch-ports
27672025-01-02T23:43:37.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62192 req_id = 16beed5c-5a40-4e73-97ad-604a26ee9b2e response_code = 200 uri = /network-bootstore-config
27682025-01-02T23:43:58.835ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6562 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = b56b0591-d38c-4128-b234-0bc93e18a6a0 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
27692025-01-02T23:44:00.025ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60985
27702025-01-02T23:44:00.025ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:60985 req_id = 1f069b3f-7d34-4e7b-a2f9-9dfb515f27b7 response_code = 200 uri = /baseboard
27712025-01-02T23:44:04.984ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46503
27722025-01-02T23:44:04.984ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46503 req_id = 9f8e6664-2615-4889-9feb-aeb5a4841df4 response_code = 200 uri = /vpc-routes
27732025-01-02T23:44:05.028ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
27742025-01-02T23:44:05.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46503 req_id = a6f5026f-bba9-424d-86bf-dfae419a1bef response_code = 204 uri = /eip-gateways
27752025-01-02T23:44:05.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46503 req_id = 3c15f82b-4317-4ac4-8497-1cbeef703931 response_code = 204 uri = /vpc-routes
27762025-01-02T23:44:05.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45891
27772025-01-02T23:44:05.103ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
27782025-01-02T23:44:05.145ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
27792025-01-02T23:44:05.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104375 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:45891 req_id = e87b15ef-a0eb-4b6a-a1b5-1c9da25b7dab response_code = 204 uri = /switch-ports
27802025-01-02T23:44:05.208ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56150
27812025-01-02T23:44:05.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45891 req_id = 5007baf4-6606-466f-81bc-3d710112425f response_code = 200 uri = /network-bootstore-config
27822025-01-02T23:44:05.208ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56150 req_id = 6123174f-6b79-4c03-abff-727bd0374fb8 response_code = 200 uri = /v2p
27832025-01-02T23:44:05.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39172
27842025-01-02T23:44:05.218ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
27852025-01-02T23:44:05.218ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27862025-01-02T23:44:05.218ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27872025-01-02T23:44:05.218ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27882025-01-02T23:44:05.218ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
27892025-01-02T23:44:05.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
27902025-01-02T23:44:05.219ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
27912025-01-02T23:44:05.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 403 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39172 req_id = c8d13205-75f8-4e5d-ba56-6b241bccfbdf response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
27922025-01-02T23:44:06.224ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37246
27932025-01-02T23:44:06.224ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27942025-01-02T23:44:06.224ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
27952025-01-02T23:44:06.224ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
27962025-01-02T23:44:06.224ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
27972025-01-02T23:44:06.236ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
27982025-01-02T23:44:06.236ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e
27992025-01-02T23:44:06.259ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28002025-01-02T23:44:06.259ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9c569eb8-99da-4c39-9e12-41759dba24d6
28012025-01-02T23:44:06.278ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28022025-01-02T23:44:06.278ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_761fec61-ade0-4579-af52-842b38e6e3a3
28032025-01-02T23:44:06.299ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28042025-01-02T23:44:06.299ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24
28052025-01-02T23:44:06.319ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28062025-01-02T23:44:06.319ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5
28072025-01-02T23:44:06.340ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28082025-01-02T23:44:06.340ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3422f079-8bbb-4453-89ec-a156fe56575a
28092025-01-02T23:44:06.361ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28102025-01-02T23:44:06.361ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd42dc62-762a-4947-84e6-57025e292015
28112025-01-02T23:44:06.384ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28122025-01-02T23:44:06.384ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d
28132025-01-02T23:44:06.404ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28142025-01-02T23:44:06.405ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6
28152025-01-02T23:44:06.416ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192055 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37246 req_id = bfe04a2e-57e9-4bc3-9671-31727893b213 response_code = 200 uri = /inventory
28162025-01-02T23:44:06.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46981
28172025-01-02T23:44:06.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46981 req_id = 9f499cec-9ddc-45e5-8e91-1c2627ac3984 response_code = 200 uri = /vpc-routes
28182025-01-02T23:44:06.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43188
28192025-01-02T23:44:06.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43188 req_id = bc3ea58c-4c2c-41c8-b31c-3919515a604f response_code = 200 uri = /v2p
28202025-01-02T23:44:06.904ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
28212025-01-02T23:44:06.904ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46981 req_id = 8fef102d-0ac8-461a-b52c-359afeef2d5e response_code = 204 uri = /eip-gateways
28222025-01-02T23:44:06.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 320 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46981 req_id = eae718cb-356e-46f1-afcc-a2d4f3f9f4b3 response_code = 204 uri = /vpc-routes
28232025-01-02T23:44:06.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43786
28242025-01-02T23:44:06.985ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28252025-01-02T23:44:07.029ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28262025-01-02T23:44:07.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99710 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43786 req_id = 8fa12fff-62a9-4bab-a623-164d03468baa response_code = 204 uri = /switch-ports
28272025-01-02T23:44:07.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43786 req_id = 734f8f34-d205-46dd-aef4-9da72ffbf4b1 response_code = 200 uri = /network-bootstore-config
28282025-01-02T23:44:07.095ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48210
28292025-01-02T23:44:07.095ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28302025-01-02T23:44:07.095ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28312025-01-02T23:44:07.095ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
28322025-01-02T23:44:07.095ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
28332025-01-02T23:44:07.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41613
28342025-01-02T23:44:07.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41613 req_id = 7b94af56-fab7-4a9d-834a-778af2ae1891 response_code = 200 uri = /vpc-routes
28352025-01-02T23:44:07.107ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28362025-01-02T23:44:07.107ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e
28372025-01-02T23:44:07.111ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43810
28382025-01-02T23:44:07.112ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28392025-01-02T23:44:07.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28402025-01-02T23:44:07.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28412025-01-02T23:44:07.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28422025-01-02T23:44:07.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28432025-01-02T23:44:07.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28442025-01-02T23:44:07.112ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28452025-01-02T23:44:07.112ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 860 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43810 req_id = d4cbd841-2ff3-4072-94f1-0118836eb20a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28462025-01-02T23:44:07.134ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28472025-01-02T23:44:07.134ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9c569eb8-99da-4c39-9e12-41759dba24d6
28482025-01-02T23:44:07.146ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
28492025-01-02T23:44:07.146ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41613 req_id = 6f7d2692-97a8-4280-bc14-9d64ce3c0191 response_code = 204 uri = /eip-gateways
28502025-01-02T23:44:07.158ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28512025-01-02T23:44:07.158ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_761fec61-ade0-4579-af52-842b38e6e3a3
28522025-01-02T23:44:07.180ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28532025-01-02T23:44:07.180ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24
28542025-01-02T23:44:07.201ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28552025-01-02T23:44:07.201ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5
28562025-01-02T23:44:07.222ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28572025-01-02T23:44:07.222ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3422f079-8bbb-4453-89ec-a156fe56575a
28582025-01-02T23:44:07.243ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28592025-01-02T23:44:07.243ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd42dc62-762a-4947-84e6-57025e292015
28602025-01-02T23:44:07.263ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28612025-01-02T23:44:07.263ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d
28622025-01-02T23:44:07.283ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28632025-01-02T23:44:07.283ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6
28642025-01-02T23:44:07.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199492 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48210 req_id = 8d93aa90-9498-4d90-8aea-f074c88b7f94 response_code = 200 uri = /inventory
28652025-01-02T23:44:07.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50516
28662025-01-02T23:44:07.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50516 req_id = 1a705518-56e9-4a3f-ae0c-93b4375ac311 response_code = 200 uri = /v2p
28672025-01-02T23:44:07.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41613 req_id = ca91010b-735f-4c77-971f-6518d32532d4 response_code = 204 uri = /vpc-routes
28682025-01-02T23:44:07.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46242
28692025-01-02T23:44:07.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
28702025-01-02T23:44:07.416ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
28712025-01-02T23:44:07.482ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108382 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46242 req_id = 7e6d1728-c4ff-4d89-aa56-49a774be7f09 response_code = 204 uri = /switch-ports
28722025-01-02T23:44:07.483ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37078
28732025-01-02T23:44:07.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28742025-01-02T23:44:07.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
28752025-01-02T23:44:07.483ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46242 req_id = 912bd707-6b24-4fdb-9de5-d8fb6a63f785 response_code = 200 uri = /network-bootstore-config
28762025-01-02T23:44:07.483ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/config/omicron-zones.json file = common/src/ledger.rs:177
28772025-01-02T23:44:07.483ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/config/omicron-zones.json file = common/src/ledger.rs:177
28782025-01-02T23:44:07.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36886
28792025-01-02T23:44:07.494ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 55412692-63eb-4a83-ba96-0216b136b40b, kind: Service { id: 3cf11230-2b59-4cce-bb9f-d43f7cd85242 }, name: Name("external-dns-3cf11230-2b59-4cce-bb9f-d43f7cd85242"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 148, 35])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: dbf21e24-01eb-4188-8cc4-49364c2147db, kind: Service { id: cf07b438-4026-4d20-a0d8-212a50bca0d8 }, name: Name("external-dns-cf07b438-4026-4d20-a0d8-212a50bca0d8"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 208, 71])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4ee09ec7-d2bc-4934-b474-597cbae7239e, kind: Service { id: 56011122-5ef5-4404-a960-4d469159f36a }, name: Name("nexus-56011122-5ef5-4404-a960-4d469159f36a"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 204])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 556ce630-9fde-438d-9808-311361bd646b, kind: Service { id: a65090c3-871f-4183-bf79-7d6e2eff40c0 }, name: Name("nexus-a65090c3-871f-4183-bf79-7d6e2eff40c0"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 229, 55])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: a6be0e9d-a846-407e-80e3-195d0c351fb5, kind: Service { id: 4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846 }, name: Name("nexus-4fb0abc9-f2dd-4c1d-89ad-7357c3cc0846"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 207, 120])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
28802025-01-02T23:44:07.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28812025-01-02T23:44:07.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28822025-01-02T23:44:07.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28832025-01-02T23:44:07.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
28842025-01-02T23:44:07.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
28852025-01-02T23:44:07.494ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
28862025-01-02T23:44:07.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:36886 req_id = 954dc6b3-46d8-4575-b2ca-a6547603005b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
28872025-01-02T23:44:07.497ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1a3f6a6f-203c-4d91-9a52-12ead519aa2e (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28882025-01-02T23:44:07.497ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1a3f6a6f-203c-4d91-9a52-12ead519aa2e
28892025-01-02T23:44:07.522ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9c569eb8-99da-4c39-9e12-41759dba24d6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28902025-01-02T23:44:07.522ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_9c569eb8-99da-4c39-9e12-41759dba24d6
28912025-01-02T23:44:07.546ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 761fec61-ade0-4579-af52-842b38e6e3a3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28922025-01-02T23:44:07.546ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_761fec61-ade0-4579-af52-842b38e6e3a3
28932025-01-02T23:44:07.569ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7fbf8a0d-d208-4feb-9cb2-8e9acee78b24 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28942025-01-02T23:44:07.569ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_7fbf8a0d-d208-4feb-9cb2-8e9acee78b24
28952025-01-02T23:44:07.591ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e0d1576f-583d-422f-96ad-a5c29b5e16a5 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28962025-01-02T23:44:07.591ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_e0d1576f-583d-422f-96ad-a5c29b5e16a5
28972025-01-02T23:44:07.612ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 3422f079-8bbb-4453-89ec-a156fe56575a (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
28982025-01-02T23:44:07.612ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_3422f079-8bbb-4453-89ec-a156fe56575a
28992025-01-02T23:44:07.632ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bd42dc62-762a-4947-84e6-57025e292015 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29002025-01-02T23:44:07.632ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_bd42dc62-762a-4947-84e6-57025e292015
29012025-01-02T23:44:07.652ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 374daf77-fd10-42c0-b0ae-1c6ddd80632d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29022025-01-02T23:44:07.652ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_374daf77-fd10-42c0-b0ae-1c6ddd80632d
29032025-01-02T23:44:07.673ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:603
29042025-01-02T23:44:07.673ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1019 request = datasets_list zpool = oxp_1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6
29052025-01-02T23:44:07.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201427 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37078 req_id = 7df94b40-8e2f-4748-ad4d-32c5d01601a7 response_code = 200 uri = /inventory
29062025-01-02T23:44:28.837ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8067 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = ae4d799b-982e-44e9-8973-485716c18315 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
29072025-01-02T23:44:30.057ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62703
29082025-01-02T23:44:30.057ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:62703 req_id = 84176c57-7e93-4365-a1e0-8288a4ad131e response_code = 200 uri = /baseboard
29092025-01-02T23:44:34.724ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53382
29102025-01-02T23:44:34.724ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53382 req_id = 8f7ee32f-76a7-478b-aa79-e85f14c1b8e0 response_code = 200 uri = /v2p
29112025-01-02T23:44:34.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52477
29122025-01-02T23:44:34.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52477 req_id = 8d46693c-3867-47af-be39-ff380e4d78db response_code = 200 uri = /vpc-routes
29132025-01-02T23:44:34.902ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
29142025-01-02T23:44:34.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52477 req_id = 62ab3d00-aa22-4269-8463-300581c5d1ff response_code = 204 uri = /eip-gateways
29152025-01-02T23:44:34.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:52477 req_id = a661f48e-cb45-405d-a6d5-edf0f1b9b7ef response_code = 204 uri = /vpc-routes
29162025-01-02T23:44:34.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52813
29172025-01-02T23:44:34.955ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29182025-01-02T23:44:34.990ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29192025-01-02T23:44:35.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92080 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52813 req_id = e0ebf3e6-2d76-46d8-8187-ddbdbcc1406d response_code = 204 uri = /switch-ports
29202025-01-02T23:44:35.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52813 req_id = 5007763d-408b-489b-ba60-66e22afb47df response_code = 200 uri = /network-bootstore-config
29212025-01-02T23:44:36.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34840
29222025-01-02T23:44:36.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34840 req_id = 77899acc-dbaa-48fe-9152-6f6ab5b289b8 response_code = 200 uri = /v2p
29232025-01-02T23:44:36.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57186
29242025-01-02T23:44:36.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57186 req_id = 5fb840f0-589d-474b-9690-fd2fb51e9bc8 response_code = 200 uri = /vpc-routes
29252025-01-02T23:44:36.839ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
29262025-01-02T23:44:36.839ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57186 req_id = 0ff7e447-0f89-47b2-bf80-df84eddabd5c response_code = 204 uri = /eip-gateways
29272025-01-02T23:44:36.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57186 req_id = b4f33cd3-9ac6-4b02-8ada-ac73a7293f55 response_code = 204 uri = /vpc-routes
29282025-01-02T23:44:36.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56898
29292025-01-02T23:44:36.916ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29302025-01-02T23:44:36.961ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29312025-01-02T23:44:37.025ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109035 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56898 req_id = 8e73810e-642f-45db-9959-2a6a83ac33b8 response_code = 204 uri = /switch-ports
29322025-01-02T23:44:37.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48240
29332025-01-02T23:44:37.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50032
29342025-01-02T23:44:37.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50032 req_id = 0cc39720-7d0b-4712-a53f-7d36e708bf8e response_code = 200 uri = /v2p
29352025-01-02T23:44:37.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48240 req_id = bab4be3f-a2ea-4cdf-90fa-42103e9f7c09 response_code = 200 uri = /vpc-routes
29362025-01-02T23:44:37.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56898 req_id = 4e507388-89e3-455f-9c99-950a76f7772a response_code = 200 uri = /network-bootstore-config
29372025-01-02T23:44:37.039ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
29382025-01-02T23:44:37.039ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48240 req_id = 97171fb5-76e3-49f4-92ed-2225a0b9d14d response_code = 204 uri = /eip-gateways
29392025-01-02T23:44:37.048ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48240 req_id = 28f31fff-2587-4668-b334-27fe92455715 response_code = 204 uri = /vpc-routes
29402025-01-02T23:44:37.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48512
29412025-01-02T23:44:37.090ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29422025-01-02T23:44:37.126ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29432025-01-02T23:44:37.187ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97772 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48512 req_id = 4ee15bf6-2db4-4b62-a92a-21e0bbcd1204 response_code = 204 uri = /switch-ports
29442025-01-02T23:44:37.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48512 req_id = 78091bd8-cdb7-4ca9-bb49-bc379811fb86 response_code = 200 uri = /network-bootstore-config
29452025-01-02T23:44:50.811ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
29462025-01-02T23:44:58.837ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7291 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = db325d04-2f0b-40ed-a7e1-0b5ab06741f9 response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
29472025-01-02T23:45:00.092ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53190
29482025-01-02T23:45:00.092ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:53190 req_id = 4dfaf994-9ab2-4550-9c38-e8ce809f0e08 response_code = 200 uri = /baseboard
29492025-01-02T23:45:04.661ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48695
29502025-01-02T23:45:04.661ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48695 req_id = 916acdc3-0e7b-4503-93a2-610b02eb9f44 response_code = 200 uri = /vpc-routes
29512025-01-02T23:45:04.714ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
29522025-01-02T23:45:04.714ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48695 req_id = e3107476-ee8b-4103-a715-4db73c9edc0f response_code = 204 uri = /eip-gateways
29532025-01-02T23:45:04.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:48695 req_id = 8089a4db-9506-49a7-aecb-cf203e898123 response_code = 204 uri = /vpc-routes
29542025-01-02T23:45:04.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53155
29552025-01-02T23:45:04.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53155 req_id = 2f1c1e9f-5405-4c6d-9e97-444ae1040901 response_code = 200 uri = /v2p
29562025-01-02T23:45:04.967ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51923
29572025-01-02T23:45:04.967ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29582025-01-02T23:45:05.005ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29592025-01-02T23:45:05.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93723 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51923 req_id = e6e82a70-f6af-4e0a-9324-ec59b24976dd response_code = 204 uri = /switch-ports
29602025-01-02T23:45:05.061ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51923 req_id = 25fdeeaf-7f96-4f58-926a-43af0bdf9ab1 response_code = 200 uri = /network-bootstore-config
29612025-01-02T23:45:06.778ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47228
29622025-01-02T23:45:06.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47228 req_id = 204c7ff2-00de-4f8d-8537-d66ea5b8af29 response_code = 200 uri = /vpc-routes
29632025-01-02T23:45:06.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61261
29642025-01-02T23:45:06.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61261 req_id = 9abf527f-d640-4689-b4d6-fffa544cbcb4 response_code = 200 uri = /v2p
29652025-01-02T23:45:06.910ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
29662025-01-02T23:45:06.910ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47228 req_id = ef459b9e-80cc-4a83-b9e1-9518bbcd14a8 response_code = 204 uri = /eip-gateways
29672025-01-02T23:45:06.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47228 req_id = 8dc24baa-c8ec-4682-a3f2-7a72002f7e90 response_code = 204 uri = /vpc-routes
29682025-01-02T23:45:07.056ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63413
29692025-01-02T23:45:07.057ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29702025-01-02T23:45:07.099ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29712025-01-02T23:45:07.168ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111893 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63413 req_id = 077bbd33-49d6-4d0a-9b36-9e7daa113ec2 response_code = 204 uri = /switch-ports
29722025-01-02T23:45:07.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55339
29732025-01-02T23:45:07.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55339 req_id = f2e13adc-e592-4e91-9b14-3d38ce17f244 response_code = 200 uri = /vpc-routes
29742025-01-02T23:45:07.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63413 req_id = 8d383a3d-bdb9-465a-bd41-a2b57b5a1737 response_code = 200 uri = /network-bootstore-config
29752025-01-02T23:45:07.270ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52796
29762025-01-02T23:45:07.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52796 req_id = dcb0b79c-b47d-4a78-a5c7-5565897f2253 response_code = 200 uri = /v2p
29772025-01-02T23:45:07.272ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
29782025-01-02T23:45:07.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55339 req_id = dd8e5301-c95d-4d5c-b4d4-6f037d67e023 response_code = 204 uri = /eip-gateways
29792025-01-02T23:45:07.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55339 req_id = 2f2553bd-3efa-46d9-ac9a-5d31192d464a response_code = 204 uri = /vpc-routes
29802025-01-02T23:45:07.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52590
29812025-01-02T23:45:07.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4119
29822025-01-02T23:45:07.342ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4143
29832025-01-02T23:45:07.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92750 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52590 req_id = 92af5a42-63d5-4655-aae1-91aa9a345ab6 response_code = 204 uri = /switch-ports
29842025-01-02T23:45:07.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52590 req_id = 69d926ea-8fcf-4e7d-ad39-ecc3d226073b response_code = 200 uri = /network-bootstore-config
29852025-01-02T23:45:08.394ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62178
29862025-01-02T23:45:08.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62178 req_id = acf81f0c-2002-4b68-8345-80deb746d9de response_code = 200 uri = /v2p
29872025-01-02T23:45:08.394ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(9118131) }
29882025-01-02T23:45:08.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62178 req_id = 2a7fb9a3-85fc-4c22-80e4-50fbbc86a500 response_code = 204 uri = /v2p
29892025-01-02T23:45:08.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56856
29902025-01-02T23:45:08.538ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 475af8bd-13fc-4a0e-b996-d88adfd5cde7, kind: Instance { id: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9118131), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 475af8bd-13fc-4a0e-b996-d88adfd5cde7, kind: Instance { id: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9118131), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 475af8bd-13fc-4a0e-b996-d88adfd5cde7, kind: Instance { id: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9118131), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9118131))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 475af8bd-13fc-4a0e-b996-d88adfd5cde7, kind: Instance { id: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9118131), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-2d8f195ec05", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: bdbd825c-742f-4136-a220-92ade7972e5b, read_only_parent: Some(Volume { block_size: 512, id: 1d5b058e-2981-486e-9ded-cd7929521561, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3483152f-9503-439e-9002-25a806a3e98f, key: Some("MaXX96LIbJvI5IH0pqZ2u9QqWSJTI5kSrxjuKl4iuEU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: bdbd825c-742f-4136-a220-92ade7972e5b, key: Some("Xz1zoMlCUPVBuyQPqq9yvDIsz1uE21IUewL1L4XR72w="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19003", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::19]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-2d8f195ec05" }] }), cloud_init_bytes: Some(..) } instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 metadata = InstanceMetadata { silo_id: 31564a6d-adef-486f-8af0-44d369c942f7, project_id: 42739ccf-2f26-4d7f-9106-56c79d73843f } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-02T23:45:08.536077576Z }
29912025-01-02T23:45:08.538ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 migration_id = None propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
29922025-01-02T23:45:08.538ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1281 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 migration_id = None propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 475af8bd-13fc-4a0e-b996-d88adfd5cde7, kind: Instance { id: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9118131), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.1.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.1.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 475af8bd-13fc-4a0e-b996-d88adfd5cde7, kind: Instance { id: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9118131), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 475af8bd-13fc-4a0e-b996-d88adfd5cde7, kind: Instance { id: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9118131), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(9118131))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 475af8bd-13fc-4a0e-b996-d88adfd5cde7, kind: Instance { id: 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(9118131), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [DiskRequest { device: "nvme", name: "disk-2d8f195ec05", read_only: false, slot: Slot(0), volume_construction_request: Volume { block_size: 512, id: bdbd825c-742f-4136-a220-92ade7972e5b, read_only_parent: Some(Volume { block_size: 512, id: 1d5b058e-2981-486e-9ded-cd7929521561, read_only_parent: None, sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 2, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: 3483152f-9503-439e-9002-25a806a3e98f, key: Some("MaXX96LIbJvI5IH0pqZ2u9QqWSJTI5kSrxjuKl4iuEU="), key_pem: None, lossy: false, read_only: true, root_cert_pem: None, target: ["[fd00:1122:3344:101::18]:19002", "[fd00:1122:3344:101::13]:19002", "[fd00:1122:3344:101::14]:19001"] } }] }), sub_volumes: [Region { block_size: 512, blocks_per_extent: 131072, extent_count: 32, gen: 1, opts: CrucibleOpts { cert_pem: None, control: None, flush_timeout: None, id: bdbd825c-742f-4136-a220-92ade7972e5b, key: Some("Xz1zoMlCUPVBuyQPqq9yvDIsz1uE21IUewL1L4XR72w="), key_pem: None, lossy: false, read_only: false, root_cert_pem: None, target: ["[fd00:1122:3344:101::13]:19003", "[fd00:1122:3344:101::1a]:19000", "[fd00:1122:3344:101::19]:19000"] } }] } }], boot_settings: Some(BootSettings { order: [BootOrderEntry { name: "disk-2d8f195ec05" }] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-02T23:45:08.536077576Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
29932025-01-02T23:45:08.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2269 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56856 req_id = 1f607fd3-52b7-4a63-800d-74fb562593f5 response_code = 200 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b
29942025-01-02T23:45:08.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50517
29952025-01-02T23:45:08.647ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2052 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50517 req_id = d6040130-f2ae-43a1-b2e8-a28c7fd01075 response_code = 200 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b/state
29962025-01-02T23:45:08.648ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 9118131 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
29972025-01-02T23:45:08.648ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
29982025-01-02T23:45:08.688ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b file = illumos-utils/src/zone.rs:325 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
29992025-01-02T23:45:08.713ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b file = illumos-utils/src/zone.rs:363 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30002025-01-02T23:45:08.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40993
30012025-01-02T23:45:08.751ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40993 req_id = 43b57989-a2be-4735-99d2-b63e79bbba32 response_code = 200 uri = /vpc-routes
30022025-01-02T23:45:08.865ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {475af8bd-13fc-4a0e-b996-d88adfd5cde7: {10.151.1.176: {3d693c5f-d59c-4ef6-a29f-9b631c9c5051}, 10.151.1.175: {3d693c5f-d59c-4ef6-a29f-9b631c9c5051}}} }
30032025-01-02T23:45:10.050ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30042025-01-02T23:45:10.050ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b zone file = illumos-utils/src/running_zone.rs:488 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b zone = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30052025-01-02T23:45:10.234ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 57.947526ms file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b zone = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30062025-01-02T23:45:10.305ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 60.006226ms file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b zone = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30072025-01-02T23:45:10.384ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 256.509012ms file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b zone = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30082025-01-02T23:45:10.656ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 553.122778ms file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b zone = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30092025-01-02T23:45:11.220ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 757.192618ms file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b zone = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30102025-01-02T23:45:11.989ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 1.494211946s file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b zone = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30112025-01-02T23:45:13.494ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 1.340399778s file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b zone = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30122025-01-02T23:45:14.845ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 609.90333ms file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b zone = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30132025-01-02T23:45:15.484ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b file = sled-agent/src/instance.rs:1786 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30142025-01-02T23:45:15.493ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 50.858017ms file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30152025-01-02T23:45:15.554ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 91.737134ms file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30162025-01-02T23:45:15.655ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b") failed: Property not found. retry in 110.138459ms file = illumos-utils/src/svc.rs:36 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30172025-01-02T23:45:15.776ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:1795 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30182025-01-02T23:45:15.812ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:1819 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30192025-01-02T23:45:15.951ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:932 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30202025-01-02T23:45:15.953ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
30212025-01-02T23:45:15.953ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7088030 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40993 req_id = 9025d91e-14f2-4e45-91a4-632ad16bd7c4 response_code = 204 uri = /eip-gateways
30222025-01-02T23:45:15.953ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-02T23:45:15.953208365Z } file = sled-agent/src/instance.rs:780 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30232025-01-02T23:45:15.953ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-02T23:45:15.953208365Z } propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30242025-01-02T23:45:15.953ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-02T23:45:15.953208365Z }, migration_in: None, migration_out: None }
30252025-01-02T23:45:16.020ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-02T23:45:16.020550441Z } file = sled-agent/src/instance.rs:780 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30262025-01-02T23:45:16.020ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-02T23:45:16.020550441Z } propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30272025-01-02T23:45:16.020ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-02T23:45:16.020550441Z }, migration_in: None, migration_out: None }
30282025-01-02T23:45:16.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40993 req_id = 3ce37a2e-25f8-4127-b123-99d4e1e67d07 response_code = 204 uri = /vpc-routes
30292025-01-02T23:45:26.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60491
30302025-01-02T23:45:26.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 695 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60491 req_id = 37c65e40-1337-422c-b2a2-b82e1f0d1018 response_code = 200 uri = /vmms/9252d818-5197-4f80-82d2-cbb5aae2539b/state
30312025-01-02T23:45:26.293ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-02T23:45:26.293508567Z } file = sled-agent/src/instance.rs:780 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30322025-01-02T23:45:26.293ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-02T23:45:26.293508567Z } propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30332025-01-02T23:45:26.293ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-02T23:45:26.293508567Z }, migration_in: None, migration_out: None }
30342025-01-02T23:45:26.331ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-02T23:45:26.331127461Z } file = sled-agent/src/instance.rs:780 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30352025-01-02T23:45:26.331ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-02T23:45:26.331127461Z } propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30362025-01-02T23:45:26.331ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30372025-01-02T23:45:26.331ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30382025-01-02T23:45:26.331ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 3438688003110793453 n_samples = 6 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
30392025-01-02T23:45:26.331ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:603
30402025-01-02T23:45:26.331ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/dbbd10b4-0e65-490e-bf68-d8076e9cc5f6/debug/bundle/zone", "/pool/int/e447c503-e3d7-466e-a61b-e086843a2be9/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/1a3f6a6f-203c-4d91-9a52-12ead519aa2e/crypt/debug", "/pool/ext/9c569eb8-99da-4c39-9e12-41759dba24d6/crypt/debug", "/pool/ext/761fec61-ade0-4579-af52-842b38e6e3a3/crypt/debug", "/pool/ext/7fbf8a0d-d208-4feb-9cb2-8e9acee78b24/crypt/debug", "/pool/ext/e0d1576f-583d-422f-96ad-a5c29b5e16a5/crypt/debug", "/pool/ext/3422f079-8bbb-4453-89ec-a156fe56575a/crypt/debug", "/pool/ext/bd42dc62-762a-4947-84e6-57025e292015/crypt/debug", "/pool/ext/374daf77-fd10-42c0-b0ae-1c6ddd80632d/crypt/debug", "/pool/ext/1fe1ac65-b9c4-4fa7-944c-78ee09b7d1b6/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b
30412025-01-02T23:45:26.331ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 2596289562887234499 n_samples = 6 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
30422025-01-02T23:45:26.981ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b", bundle_id: 493239aa-9a5f-4176-b82d-fc1b255a3f0e }, time_created: 2025-01-02T23:45:26.332486969Z, version: 0, cause: TerminatedInstance }
30432025-01-02T23:45:26.981ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_9252d818-5197-4f80-82d2-cbb5aae2539b file = sled-agent/src/instance.rs:1032 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30442025-01-02T23:45:28.752ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30452025-01-02T23:45:28.768ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(9118131), kind: System }
30462025-01-02T23:45:28.768ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(9118131), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
30472025-01-02T23:45:28.769ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-02T23:45:28.769049985Z }, migration_in: None, migration_out: None }
30482025-01-02T23:45:28.827ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-02T23:45:28.769049985Z }, migration_in: None, migration_out: None }
30492025-01-02T23:45:28.833ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:969 instance_id = 59da1fac-29cb-4f7b-9e6c-f100663b7ba2 propolis_id = 9252d818-5197-4f80-82d2-cbb5aae2539b
30502025-01-02T23:45:28.836ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5708 local_addr = [fd00:1122:3344:101::1]:44001 method = GET remote_addr = [fd00:1122:3344:101::d]:59735 req_id = d8f8304e-8856-4840-9cee-0e5d46c5588b response_code = 200 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 uri = /8a1161d7-6d62-4983-bc09-f43d060ae472
30512025-01-02T23:45:29.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53633
30522025-01-02T23:45:29.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53633 req_id = c9018bde-9ee2-4003-9619-ddc680b307a5 response_code = 200 uri = /vpc-routes
30532025-01-02T23:45:29.506ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
30542025-01-02T23:45:29.506ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1243 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472
30552025-01-02T23:45:29.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53633 req_id = 42296786-0583-45b9-b671-2fbcb131690b response_code = 204 uri = /eip-gateways
30562025-01-02T23:45:29.515ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53633 req_id = be73302e-95f8-4f9a-a30f-7c87ad4e3d94 response_code = 204 uri = /vpc-routes
30572025-01-02T23:45:29.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37644
30582025-01-02T23:45:29.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37644 req_id = 467b6615-c883-45d1-b89d-a9df0a763a62 response_code = 200 uri = /v2p
30592025-01-02T23:45:30.126ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63594
30602025-01-02T23:45:30.127ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fdb0:18c0:4d0d:9fb2::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:9fb2::2]:63594 req_id = b0085257-09bf-4604-9995-4e59d8ea5d7c response_code = 200 uri = /baseboard
30612025-01-02T23:45:30.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64337
30622025-01-02T23:45:30.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64337 req_id = 9bd0dfef-392b-46cc-a776-88f132531331 response_code = 200 uri = /v2p
30632025-01-02T23:45:30.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39083
30642025-01-02T23:45:30.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39083 req_id = 305cb9de-b4b3-4efa-9c9e-39f1634e9cdf response_code = 200 uri = /vpc-routes
30652025-01-02T23:45:30.857ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
30662025-01-02T23:45:30.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39083 req_id = 3577ac7b-f101-446f-b3be-30299a363f94 response_code = 204 uri = /eip-gateways
30672025-01-02T23:45:30.866ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39083 req_id = 8e8bec6a-793c-4355-9054-6f6c6ee8f757 response_code = 204 uri = /vpc-routes
30682025-01-02T23:45:31.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40281
30692025-01-02T23:45:31.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40281 req_id = 6057bed1-c453-44cf-af98-0f82a6571527 response_code = 200 uri = /vpc-routes
30702025-01-02T23:45:31.465ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1217 sled_id = 8a1161d7-6d62-4983-bc09-f43d060ae472 values = ExternalIpGatewayMap { mappings: {} }
30712025-01-02T23:45:31.465ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40281 req_id = f73cb651-3160-4c90-ad62-aace88aac795 response_code = 204 uri = /eip-gateways
30722025-01-02T23:45:31.472ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40281 req_id = a90144fb-4c1f-4cfe-a7d7-81cbf5da40c9 response_code = 204 uri = /vpc-routes