Max level shown:
1 [ Jan 9 01:53:10 Enabled. ]
2 [ Jan 9 01:53:10 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 9 01:53:10 Method "start" exited with status 0. ]
4 [ Jan 9 01:53:10 Rereading configuration. ]
5 [ Jan 9 01:53:10 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-09T01:53:10.725ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-09T01:53:10.725ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-09T01:53:10.777ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-09T01:53:10.777ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-09T01:53:10.892ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-09T01:53:10.901ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-09T01:53:10.909ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-09T01:53:11.513ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-09T01:53:11.651ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-09T01:53:11.651ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-09T01:53:11.651ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-09T01:53:11.651ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-09T01:53:11.651ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-01-09T01:53:11.651ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-09T01:53:11.654ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-09T01:53:11.654ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-09T01:53:11.654ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-09T01:53:11.654ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-09T01:53:11.654ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-09T01:53:11.654ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-09T01:53:11.654ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-09T01:53:11.654ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-09T01:53:11.654ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-09T01:53:11.666ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-09T01:53:11.666ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool)
322025-01-09T01:53:11.769ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal }
332025-01-09T01:53:12.128ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-09T01:53:12.128ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-09T01:53:12.128ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-09T01:53:12.128ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-09T01:53:12.128ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-09T01:53:12.128ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-09T01:53:12.128ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-09T01:53:12.137ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-09T01:53:12.137ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool)
422025-01-09T01:53:12.228ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal }
432025-01-09T01:53:12.589ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-09T01:53:12.589ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-09T01:53:12.589ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-09T01:53:12.589ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-09T01:53:12.589ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-09T01:53:12.589ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-09T01:53:12.589ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
532025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
542025-01-09T01:53:12.589ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-09T01:53:12.589ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-09T01:53:12.589ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
572025-01-09T01:53:12.589ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
582025-01-09T01:53:12.589ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
592025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
602025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
612025-01-09T01:53:12.589ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-09T01:53:12.589ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632025-01-09T01:53:12.589ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
642025-01-09T01:53:12.589ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
652025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672025-01-09T01:53:12.589ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-09T01:53:12.589ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
692025-01-09T01:53:12.589ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702025-01-09T01:53:12.589ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732025-01-09T01:53:12.589ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-09T01:53:12.589ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-09T01:53:12.589ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-09T01:53:12.589ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-09T01:53:12.589ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-09T01:53:12.589ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-09T01:53:12.589ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-09T01:53:12.590ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-09T01:53:12.590ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-09T01:53:12.590ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-09T01:53:12.590ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-09T01:53:12.590ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-09T01:53:12.590ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
872025-01-09T01:53:12.590ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
882025-01-09T01:53:12.590ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
892025-01-09T01:53:12.590ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
902025-01-09T01:53:12.590ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
912025-01-09T01:53:12.590ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-09T01:53:12.590ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-09T01:53:12.590ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-09T01:53:12.590ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-01-09T01:53:12.590ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-09T01:53:12.590ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-09T01:53:12.590ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-09T01:53:12.590ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-09T01:53:12.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1002025-01-09T01:53:12.590ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1012025-01-09T01:53:12.590ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1022025-01-09T01:53:12.590ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1032025-01-09T01:53:12.590ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-09T01:53:12.590ZINFOSledAgent (bootstore): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-09T01:53:12.590ZINFOSledAgent (bootstore): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-09T01:53:12.590ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-09T01:53:12.590ZINFOSledAgent (bootstore): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-09T01:53:12.590ZINFOSledAgent (bootstore): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-09T01:53:12.590ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-09T01:53:12.590ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-09T01:53:12.590ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-09T01:53:12.601ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:748
1132025-01-09T01:53:12.601ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1116, tv_nsec: 81174153 } time_to_next_cleanup = 599.999935449s
1142025-01-09T01:53:12.601ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
1152025-01-09T01:53:12.601ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-09T01:53:12.604ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-09T01:53:12.604ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-09T01:53:12.604ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-09T01:53:12.606ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-09T01:53:12.606ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-09T01:53:12.606ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-09T01:53:12.606ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-09T01:53:12.606ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-09T01:53:12.606ZINFOSledAgent (RSS): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-09T01:53:12.606ZINFOSledAgent (RSS): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-09T01:53:12.606ZINFOSledAgent (RSS): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-09T01:53:12.606ZINFOSledAgent (RSS): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-09T01:53:12.606ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-09T01:53:12.606ZINFOSledAgent (RSS): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-09T01:53:12.606ZINFOSledAgent (RSS): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-09T01:53:12.607ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-09T01:53:12.607ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-09T01:53:12.607ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-09T01:53:12.607ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-09T01:53:12.607ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-09T01:53:12.607ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-09T01:53:12.607ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-09T01:53:12.607ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-09T01:53:12.607ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e6fecef6-14a9-49d3-a8bb-39ae9e1483bd (sled), rack_id: 763db3d3-4c43-4ed5-8d9c-77e8932637e9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-09T01:53:12.608ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4270
1412025-01-09T01:53:12.608ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4664
1422025-01-09T01:53:12.612ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-09T01:53:12.618ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-09T01:53:12.618ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-09T01:53:12.622ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-09T01:53:12.622ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-09T01:53:12.622ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:65156
1482025-01-09T01:53:12.623ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: e6fecef6-14a9-49d3-a8bb-39ae9e1483bd (sled), rack_id: 763db3d3-4c43-4ed5-8d9c-77e8932637e9, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-09T01:53:12.623ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-09T01:53:12.623ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-09T01:53:12.623ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1522025-01-09T01:53:12.623ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1532025-01-09T01:53:12.623ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1542025-01-09T01:53:12.623ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1552025-01-09T01:53:12.623ZINFOSledAgent (StorageManager): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1562025-01-09T01:53:12.623ZINFOSledAgent (StorageManager): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-09T01:53:12.623ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-09T01:53:12.623ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-09T01:53:12.623ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-09T01:53:12.623ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-09T01:53:12.623ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-09T01:53:12.639ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-09T01:53:12.659ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-09T01:53:12.676ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-09T01:53:12.700ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:412 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
1662025-01-09T01:53:12.700ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-09T01:53:12.700ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:424 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
1682025-01-09T01:53:12.701ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-09T01:53:12.704ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 88.916539ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "52312d61-48f9-4a40-82fa-9b0015242bb9", "content-length": "124", "date": "Thu, 09 Jan 2025 01:53:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "52312d61-48f9-4a40-82fa-9b0015242bb9" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-09T01:53:12.714ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-09T01:53:12.738ZINFOSledAgent: successfully created encrypted zvol: name="oxi_6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-09T01:53:12.738ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-09T01:53:12.743ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:439 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
1742025-01-09T01:53:12.743ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-09T01:53:12.743ZINFOSledAgent (BackingFs): Ensuring dataset oxi_6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-09T01:53:12.793ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-09T01:53:12.794ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 84.604741ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7a28c395-9f6d-4931-a04d-771509e70772", "content-length": "124", "date": "Thu, 09 Jan 2025 01:53:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7a28c395-9f6d-4931-a04d-771509e70772" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-09T01:53:12.811ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-09T01:53:12.879ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-09T01:53:12.880ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 204.773333ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "43fd22d5-6463-4cfb-92db-62a6d2d4d027", "content-length": "124", "date": "Thu, 09 Jan 2025 01:53:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "43fd22d5-6463-4cfb-92db-62a6d2d4d027" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-09T01:53:13.030ZINFOSledAgent (BackingFs): Mounting oxi_6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-09T01:53:13.043ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-09T01:53:13.043ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-09T01:53:13.043ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-09T01:53:13.043ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-09T01:53:13.085ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-09T01:53:13.086ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 141.214243ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d16032d1-fa2e-4852-9d0d-64d931068aa7", "content-length": "124", "date": "Thu, 09 Jan 2025 01:53:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d16032d1-fa2e-4852-9d0d-64d931068aa7" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-09T01:53:13.228ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-09T01:53:13.229ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 229.280116ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "fb60d6e0-cbee-4be4-8a4b-81e790394e43", "content-length": "124", "date": "Thu, 09 Jan 2025 01:53:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "fb60d6e0-cbee-4be4-8a4b-81e790394e43" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-09T01:53:13.459ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-09T01:53:13.460ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 238.858736ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f40a3441-c1b0-4889-9bcb-a5c7b49f8c6f", "content-length": "124", "date": "Thu, 09 Jan 2025 01:53:12 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f40a3441-c1b0-4889-9bcb-a5c7b49f8c6f" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-09T01:53:13.700ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1932025-01-09T01:53:13.701ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 358.634395ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "4379238e-823f-4817-8fa4-d927109c5081", "content-length": "124", "date": "Thu, 09 Jan 2025 01:53:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "4379238e-823f-4817-8fa4-d927109c5081" } file = clients/ddm-admin-client/src/lib.rs:177
1942025-01-09T01:53:13.789ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
1952025-01-09T01:53:13.795ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:49866 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
1962025-01-09T01:53:13.795ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
1972025-01-09T01:53:13.795ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:49866 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
1982025-01-09T01:53:13.796ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 358.406022ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
1992025-01-09T01:53:13.797ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2002025-01-09T01:53:13.797ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2012025-01-09T01:53:13.797ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:932 underlay_address = fd00:1122:3344:101::1
2022025-01-09T01:53:13.797ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2032025-01-09T01:53:14.060ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2042025-01-09T01:53:14.156ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 567.007151ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2052025-01-09T01:53:14.724ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.237520696s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2062025-01-09T01:53:15.963ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.590189012s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2072025-01-09T01:53:16.411ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2694
2082025-01-09T01:53:16.411ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2939
2092025-01-09T01:53:16.411ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2564
2102025-01-09T01:53:16.411ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2611
2112025-01-09T01:53:16.411ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3020
2122025-01-09T01:53:16.411ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3065
2132025-01-09T01:53:16.413ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2864
2142025-01-09T01:53:16.414ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2605
2152025-01-09T01:53:16.414ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='9a4bc614-e44a-464f-aee8-ab24c969f240'/> <propval type="astring" name="rack_id" value='763db3d3-4c43-4ed5-8d9c-77e8932637e9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe2d:519a'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='763db3d3-4c43-4ed5-8d9c-77e8932637e9'/> <propval type="astring" name="sled_id" value='e6fecef6-14a9-49d3-a8bb-39ae9e1483bd'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='e6fecef6-14a9-49d3-a8bb-39ae9e1483bd'/> <propval type="astring" name="rack_uuid" value='763db3d3-4c43-4ed5-8d9c-77e8932637e9'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='e6fecef6-14a9-49d3-a8bb-39ae9e1483bd'/> <propval type="astring" name="rack_uuid" value='763db3d3-4c43-4ed5-8d9c-77e8932637e9'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2162025-01-09T01:53:16.414ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2172025-01-09T01:53:16.696ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 58.493394ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2182025-01-09T01:53:16.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 75.256139ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2192025-01-09T01:53:17.083ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 184.837879ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2202025-01-09T01:53:17.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 414.769178ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2212025-01-09T01:53:17.554ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.92191164s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2222025-01-09T01:53:18.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 653.767997ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2232025-01-09T01:53:18.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 966.478122ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2242025-01-09T01:53:19.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 772.998568ms file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2252025-01-09T01:53:20.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.153275295s file = illumos-utils/src/svc.rs:36 zone = oxz_switch
2262025-01-09T01:53:22.391ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/e6fecef6-14a9-49d3-a8bb-39ae9e1483bd) file = sled-agent/src/nexus.rs:527 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2272025-01-09T01:53:22.421ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282025-01-09T01:53:22.421ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2292025-01-09T01:53:22.423ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::1]:12345
2302025-01-09T01:53:22.423ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2312025-01-09T01:53:22.423ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2322025-01-09T01:53:22.423ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2332025-01-09T01:53:22.423ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2342025-01-09T01:53:22.423ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2352025-01-09T01:53:22.423ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2362025-01-09T01:53:22.423ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3973
2372025-01-09T01:53:22.423ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:65156
2382025-01-09T01:53:22.629ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2392025-01-09T01:53:22.629ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2402025-01-09T01:53:22.630ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 6.851899945s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2412025-01-09T01:53:22.635ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4294 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2422025-01-09T01:53:23.593ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6fecef6-14a9-49d3-a8bb-39ae9e1483bd) file = sled-agent/src/probe_manager.rs:231 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2432025-01-09T01:53:23.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41386
2442025-01-09T01:53:23.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2452025-01-09T01:53:23.596ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2462025-01-09T01:53:23.596ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:188
2472025-01-09T01:53:23.596ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:188
2482025-01-09T01:53:23.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 362 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41386 req_id = b65871d3-d1a0-425f-87b0-3fd5b1cfaa01 response_code = 200 uri = /inventory
2492025-01-09T01:53:23.820ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7956359473525979411 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2502025-01-09T01:53:23.821ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5240800129435882753 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2512025-01-09T01:53:23.827ZINFOSledAgent (ServiceManager): refreshed zone-network-setup service with new configuration file = sled-agent/src/services.rs:4343
2522025-01-09T01:53:23.827ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4401
2532025-01-09T01:53:24.048ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2542025-01-09T01:53:24.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39413
2552025-01-09T01:53:24.076ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39413 req_id = b18613b5-fe11-4b3f-af5a-8702e3387091 response_code = 200 uri = /sled-role
2562025-01-09T01:53:24.121ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9913e4b9-a38f-42b0-b8da-5780938c6a79 (physical_disk), pool_id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3a6e5b81-41d5-48fc-99e2-28a675ca4c3d (physical_disk), pool_id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 07546ef0-9341-4984-80f7-e53817c0fac9 (physical_disk), pool_id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 698cecfd-aa3f-48db-b5cc-2cf1bf9e94ec (physical_disk), pool_id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 66b918da-c3aa-4de3-9145-9e2865945657 (physical_disk), pool_id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: fb438629-ce4d-46f2-ba11-13ec3f203968 (physical_disk), pool_id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 8905df64-cad3-4a95-8855-65d105699bc7 (physical_disk), pool_id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: ce95ddf4-332c-45c1-8e67-165eca055b26 (physical_disk), pool_id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 06508d6c-bbd6-4637-886f-d9ecfa302105 (physical_disk), pool_id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2572025-01-09T01:53:24.121ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41255
2582025-01-09T01:53:24.121ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:893 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
2592025-01-09T01:53:24.121ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 9913e4b9-a38f-42b0-b8da-5780938c6a79 (physical_disk), pool_id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: 3a6e5b81-41d5-48fc-99e2-28a675ca4c3d (physical_disk), pool_id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 07546ef0-9341-4984-80f7-e53817c0fac9 (physical_disk), pool_id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 698cecfd-aa3f-48db-b5cc-2cf1bf9e94ec (physical_disk), pool_id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 66b918da-c3aa-4de3-9145-9e2865945657 (physical_disk), pool_id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: fb438629-ce4d-46f2-ba11-13ec3f203968 (physical_disk), pool_id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 8905df64-cad3-4a95-8855-65d105699bc7 (physical_disk), pool_id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: ce95ddf4-332c-45c1-8e67-165eca055b26 (physical_disk), pool_id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 06508d6c-bbd6-4637-886f-d9ecfa302105 (physical_disk), pool_id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2602025-01-09T01:53:24.121ZINFOSledAgent (StorageManager): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2612025-01-09T01:53:24.121ZINFOSledAgent (StorageManager): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2622025-01-09T01:53:24.121ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2632025-01-09T01:53:24.121ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2642025-01-09T01:53:24.121ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2652025-01-09T01:53:24.121ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2662025-01-09T01:53:24.121ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2672025-01-09T01:53:24.132ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2682025-01-09T01:53:24.132ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool)
2692025-01-09T01:53:24.192ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4467
2702025-01-09T01:53:24.192ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4494
2712025-01-09T01:53:24.233ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }
2722025-01-09T01:53:24.241ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2732025-01-09T01:53:24.241ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2742025-01-09T01:53:24.241ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2752025-01-09T01:53:24.241ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2762025-01-09T01:53:24.241ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2772025-01-09T01:53:24.241ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2782025-01-09T01:53:24.241ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2792025-01-09T01:53:24.278ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2802025-01-09T01:53:24.286ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone file = sled-storage/src/dataset.rs:302
2812025-01-09T01:53:24.423ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2414008d-221a-4a74-800b-eda0a3acdf4d file = sled-storage/src/dataset.rs:388
2822025-01-09T01:53:24.431ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2832025-01-09T01:53:24.431ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2842025-01-09T01:53:24.431ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2852025-01-09T01:53:24.431ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2862025-01-09T01:53:24.431ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2872025-01-09T01:53:24.440ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2882025-01-09T01:53:24.440ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool)
2892025-01-09T01:53:24.530ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }
2902025-01-09T01:53:24.539ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2912025-01-09T01:53:24.539ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2922025-01-09T01:53:24.539ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2932025-01-09T01:53:24.539ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2942025-01-09T01:53:24.539ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2952025-01-09T01:53:24.539ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2962025-01-09T01:53:24.539ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2972025-01-09T01:53:24.571ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2982025-01-09T01:53:24.580ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone file = sled-storage/src/dataset.rs:302
2992025-01-09T01:53:24.595ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6fecef6-14a9-49d3-a8bb-39ae9e1483bd) file = sled-agent/src/probe_manager.rs:231 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
3002025-01-09T01:53:24.721ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 file = sled-storage/src/dataset.rs:388
3012025-01-09T01:53:24.729ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
3022025-01-09T01:53:24.729ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
3032025-01-09T01:53:24.730ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
3042025-01-09T01:53:24.730ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3052025-01-09T01:53:24.730ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3062025-01-09T01:53:24.739ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3072025-01-09T01:53:24.739ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool)
3082025-01-09T01:53:24.833ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }
3092025-01-09T01:53:24.841ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3102025-01-09T01:53:24.841ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3112025-01-09T01:53:24.841ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3122025-01-09T01:53:24.841ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3132025-01-09T01:53:24.841ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3142025-01-09T01:53:24.841ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3152025-01-09T01:53:24.841ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3162025-01-09T01:53:24.878ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3172025-01-09T01:53:24.886ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crypt/zone file = sled-storage/src/dataset.rs:302
3182025-01-09T01:53:25.026ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_6f3f94ab-1776-457a-b887-7085a2c11828 file = sled-storage/src/dataset.rs:388
3192025-01-09T01:53:25.033ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3202025-01-09T01:53:25.033ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3212025-01-09T01:53:25.033ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3222025-01-09T01:53:25.033ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3232025-01-09T01:53:25.033ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3242025-01-09T01:53:25.043ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3252025-01-09T01:53:25.043ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool)
3262025-01-09T01:53:25.138ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }
3272025-01-09T01:53:25.145ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3282025-01-09T01:53:25.146ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3292025-01-09T01:53:25.146ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3302025-01-09T01:53:25.146ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3312025-01-09T01:53:25.146ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3322025-01-09T01:53:25.146ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3332025-01-09T01:53:25.146ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3342025-01-09T01:53:25.179ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3352025-01-09T01:53:25.187ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/zone file = sled-storage/src/dataset.rs:302
3362025-01-09T01:53:25.324ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8 file = sled-storage/src/dataset.rs:388
3372025-01-09T01:53:25.331ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3382025-01-09T01:53:25.331ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3392025-01-09T01:53:25.331ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3402025-01-09T01:53:25.331ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3412025-01-09T01:53:25.331ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3422025-01-09T01:53:25.341ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3432025-01-09T01:53:25.341ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool)
3442025-01-09T01:53:25.438ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }
3452025-01-09T01:53:25.446ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3462025-01-09T01:53:25.446ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3472025-01-09T01:53:25.446ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3482025-01-09T01:53:25.446ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3492025-01-09T01:53:25.446ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3502025-01-09T01:53:25.446ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3512025-01-09T01:53:25.446ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3522025-01-09T01:53:25.484ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3532025-01-09T01:53:25.492ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/zone file = sled-storage/src/dataset.rs:302
3542025-01-09T01:53:25.598ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6fecef6-14a9-49d3-a8bb-39ae9e1483bd) file = sled-agent/src/probe_manager.rs:231 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
3552025-01-09T01:53:25.633ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_e3b35f00-104f-4cfc-b343-844e77de82c6 file = sled-storage/src/dataset.rs:388
3562025-01-09T01:53:25.642ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3572025-01-09T01:53:25.642ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3582025-01-09T01:53:25.642ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3592025-01-09T01:53:25.642ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3602025-01-09T01:53:25.642ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3612025-01-09T01:53:25.652ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3622025-01-09T01:53:25.652ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool)
3632025-01-09T01:53:25.748ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }
3642025-01-09T01:53:25.757ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3652025-01-09T01:53:25.757ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3662025-01-09T01:53:25.757ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3672025-01-09T01:53:25.757ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3682025-01-09T01:53:25.757ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3692025-01-09T01:53:25.757ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3702025-01-09T01:53:25.757ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3712025-01-09T01:53:25.792ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3722025-01-09T01:53:25.800ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/zone file = sled-storage/src/dataset.rs:302
3732025-01-09T01:53:25.939ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963 file = sled-storage/src/dataset.rs:388
3742025-01-09T01:53:25.948ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3752025-01-09T01:53:25.948ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3762025-01-09T01:53:25.948ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3772025-01-09T01:53:25.948ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3782025-01-09T01:53:25.948ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3792025-01-09T01:53:25.958ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3802025-01-09T01:53:25.958ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool)
3812025-01-09T01:53:26.054ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }
3822025-01-09T01:53:26.062ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3832025-01-09T01:53:26.062ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3842025-01-09T01:53:26.062ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3852025-01-09T01:53:26.062ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3862025-01-09T01:53:26.062ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3872025-01-09T01:53:26.063ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3882025-01-09T01:53:26.063ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3892025-01-09T01:53:26.097ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3902025-01-09T01:53:26.105ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/zone file = sled-storage/src/dataset.rs:302
3912025-01-09T01:53:26.248ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c file = sled-storage/src/dataset.rs:388
3922025-01-09T01:53:26.256ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3932025-01-09T01:53:26.256ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3942025-01-09T01:53:26.256ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3952025-01-09T01:53:26.256ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3962025-01-09T01:53:26.256ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3972025-01-09T01:53:26.266ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3982025-01-09T01:53:26.266ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool)
3992025-01-09T01:53:26.362ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }
4002025-01-09T01:53:26.370ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
4012025-01-09T01:53:26.370ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
4022025-01-09T01:53:26.370ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
4032025-01-09T01:53:26.370ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
4042025-01-09T01:53:26.370ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4052025-01-09T01:53:26.371ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4062025-01-09T01:53:26.371ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4072025-01-09T01:53:26.407ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4082025-01-09T01:53:26.414ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/zone file = sled-storage/src/dataset.rs:302
4092025-01-09T01:53:26.556ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3 file = sled-storage/src/dataset.rs:388
4102025-01-09T01:53:26.565ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4112025-01-09T01:53:26.565ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4122025-01-09T01:53:26.565ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4132025-01-09T01:53:26.565ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4142025-01-09T01:53:26.565ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4152025-01-09T01:53:26.575ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4162025-01-09T01:53:26.575ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool)
4172025-01-09T01:53:26.671ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }
4182025-01-09T01:53:26.679ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4192025-01-09T01:53:26.679ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4202025-01-09T01:53:26.679ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4212025-01-09T01:53:26.679ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4222025-01-09T01:53:26.679ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4232025-01-09T01:53:26.679ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4242025-01-09T01:53:26.679ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4252025-01-09T01:53:26.683ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6fecef6-14a9-49d3-a8bb-39ae9e1483bd) file = sled-agent/src/probe_manager.rs:231 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4262025-01-09T01:53:26.728ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4272025-01-09T01:53:26.737ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13/crypt/zone file = sled-storage/src/dataset.rs:302
4282025-01-09T01:53:26.876ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13 file = sled-storage/src/dataset.rs:388
4292025-01-09T01:53:26.883ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4302025-01-09T01:53:26.883ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4312025-01-09T01:53:26.883ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4322025-01-09T01:53:26.883ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: ead9d093-2dbf-48c5-ad15-3f99074b7078 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4332025-01-09T01:53:26.883ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4342025-01-09T01:53:26.883ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4352025-01-09T01:53:26.883ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4362025-01-09T01:53:26.884ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:897 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4372025-01-09T01:53:26.884ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4382025-01-09T01:53:26.884ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:923 generation = Generation(2) sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4392025-01-09T01:53:26.884ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:928 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4402025-01-09T01:53:26.884ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:933 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4412025-01-09T01:53:26.884ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4422025-01-09T01:53:26.884ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:939 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4432025-01-09T01:53:26.884ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4442025-01-09T01:53:26.884ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:944 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4452025-01-09T01:53:26.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2762693 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41255 req_id = b15025e5-54ba-475b-8265-a9b557cdd42a response_code = 200 uri = /omicron-physical-disks
4462025-01-09T01:53:26.915ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {032928e1-58f5-41b4-a2a6-59dbbfd42021 (dataset): DatasetConfig { id: 032928e1-58f5-41b4-a2a6-59dbbfd42021 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 05306e31-fdc2-4e88-83e1-77c796ac17af (dataset): DatasetConfig { id: 05306e31-fdc2-4e88-83e1-77c796ac17af (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05abc4ea-4f65-425f-9f5e-210dbc28824e (dataset): DatasetConfig { id: 05abc4ea-4f65-425f-9f5e-210dbc28824e (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07e6751f-b391-4d3e-bbc9-d1c53b78e241 (dataset): DatasetConfig { id: 07e6751f-b391-4d3e-bbc9-d1c53b78e241 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10966838-46ab-44a2-8409-3af4f56d432a (dataset): DatasetConfig { id: 10966838-46ab-44a2-8409-3af4f56d432a (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10c3352e-b4e3-4032-afe1-f11d10119b1c (dataset): DatasetConfig { id: 10c3352e-b4e3-4032-afe1-f11d10119b1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1235d8ab-2900-460c-8d36-967fdbae7d2b (dataset): DatasetConfig { id: 1235d8ab-2900-460c-8d36-967fdbae7d2b (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1813d753-1306-4957-8c53-90269554929b (dataset): DatasetConfig { id: 1813d753-1306-4957-8c53-90269554929b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18c133e4-7e1a-4ac1-a417-f9e870dccea8 (dataset): DatasetConfig { id: 18c133e4-7e1a-4ac1-a417-f9e870dccea8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ca3416b-82c6-42ac-890e-84875d455354 (dataset): DatasetConfig { id: 1ca3416b-82c6-42ac-890e-84875d455354 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f7efcec-8e97-4e30-9fd6-3ef0089995e7 (dataset): DatasetConfig { id: 1f7efcec-8e97-4e30-9fd6-3ef0089995e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 238df78b-f436-4186-83c8-8a0556c326ae (dataset): DatasetConfig { id: 238df78b-f436-4186-83c8-8a0556c326ae (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2987b6f2-74c6-4bc1-874a-2c165cac19c0 (dataset): DatasetConfig { id: 2987b6f2-74c6-4bc1-874a-2c165cac19c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c5061da-0600-4cee-8949-67cb945e6e64 (dataset): DatasetConfig { id: 2c5061da-0600-4cee-8949-67cb945e6e64 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35bd2eb2-6a74-4703-ab15-fa317565bf8e (dataset): DatasetConfig { id: 35bd2eb2-6a74-4703-ab15-fa317565bf8e (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 407d80ee-8e31-429d-81ac-24c3d746c9ed (dataset): DatasetConfig { id: 407d80ee-8e31-429d-81ac-24c3d746c9ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42aff64c-9167-430e-a70d-9a178d20fcd1 (dataset): DatasetConfig { id: 42aff64c-9167-430e-a70d-9a178d20fcd1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46a65cfa-991f-4084-b81f-66e7b560511c (dataset): DatasetConfig { id: 46a65cfa-991f-4084-b81f-66e7b560511c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ba82607-7a4b-4f88-8409-2806eb129b75 (dataset): DatasetConfig { id: 4ba82607-7a4b-4f88-8409-2806eb129b75 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c0f2a4b-eb52-4881-ad52-26f252d90da8 (dataset): DatasetConfig { id: 4c0f2a4b-eb52-4881-ad52-26f252d90da8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ce9cec4-507b-4a8b-a6c7-353793218388 (dataset): DatasetConfig { id: 4ce9cec4-507b-4a8b-a6c7-353793218388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e4c9b87-04bb-4a39-b18d-9747e96a77ec (dataset): DatasetConfig { id: 4e4c9b87-04bb-4a39-b18d-9747e96a77ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 50f18f6f-8a11-43f4-a3ab-0b632010ee66 (dataset): DatasetConfig { id: 50f18f6f-8a11-43f4-a3ab-0b632010ee66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59f71c02-1039-441f-b762-7935832968e3 (dataset): DatasetConfig { id: 59f71c02-1039-441f-b762-7935832968e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c4b83a1-6426-42a7-b8f5-51dca334ddfc (dataset): DatasetConfig { id: 5c4b83a1-6426-42a7-b8f5-51dca334ddfc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5e6d97c6-cdbf-4a67-9330-34a0c3519d8c (dataset): DatasetConfig { id: 5e6d97c6-cdbf-4a67-9330-34a0c3519d8c (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66fa9d22-a640-4982-8055-6106b0f5275f (dataset): DatasetConfig { id: 66fa9d22-a640-4982-8055-6106b0f5275f (dataset), name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6aae9f38-4844-48bc-94cb-0b3804ffb447 (dataset): DatasetConfig { id: 6aae9f38-4844-48bc-94cb-0b3804ffb447 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b1f8dd2-293a-4eb8-9dcb-09ff90598fce (dataset): DatasetConfig { id: 6b1f8dd2-293a-4eb8-9dcb-09ff90598fce (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b3bf21b-334b-47cf-80a9-29095ba59c19 (dataset): DatasetConfig { id: 6b3bf21b-334b-47cf-80a9-29095ba59c19 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cb1176b-1c0b-491f-92ad-ba6c62e5991e (dataset): DatasetConfig { id: 6cb1176b-1c0b-491f-92ad-ba6c62e5991e (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dba5718-fad2-46a5-9133-f8d5c1884eba (dataset): DatasetConfig { id: 6dba5718-fad2-46a5-9133-f8d5c1884eba (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 790a7d2f-fec4-4d33-b391-ed8477f2c62d (dataset): DatasetConfig { id: 790a7d2f-fec4-4d33-b391-ed8477f2c62d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d433762-f1dd-4ef3-8d13-1c78801b82a3 (dataset): DatasetConfig { id: 7d433762-f1dd-4ef3-8d13-1c78801b82a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 853a33aa-4891-4501-807c-5730c2761ef1 (dataset): DatasetConfig { id: 853a33aa-4891-4501-807c-5730c2761ef1 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 88775654-46ad-4998-84fb-33143290ca5e (dataset): DatasetConfig { id: 88775654-46ad-4998-84fb-33143290ca5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 892989de-d926-4357-8f52-1e1aeb5e4548 (dataset): DatasetConfig { id: 892989de-d926-4357-8f52-1e1aeb5e4548 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f46375e-ce50-4687-9e37-2298f522f716 (dataset): DatasetConfig { id: 8f46375e-ce50-4687-9e37-2298f522f716 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92be3047-5909-46b4-8057-d4a3410fd04f (dataset): DatasetConfig { id: 92be3047-5909-46b4-8057-d4a3410fd04f (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6d2f8b0-1e71-449f-9f59-52da53aa9054 (dataset): DatasetConfig { id: a6d2f8b0-1e71-449f-9f59-52da53aa9054 (dataset), name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a73d8502-d4cc-4798-a227-9c3991b7bb7d (dataset): DatasetConfig { id: a73d8502-d4cc-4798-a227-9c3991b7bb7d (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a8c419aa-94bf-45ca-9e55-fc5327df75e3 (dataset): DatasetConfig { id: a8c419aa-94bf-45ca-9e55-fc5327df75e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8ec726c-a244-4a9d-b61e-448ce85525be (dataset): DatasetConfig { id: a8ec726c-a244-4a9d-b61e-448ce85525be (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac7d45a6-6a46-4821-ae4f-411c04fbfe89 (dataset): DatasetConfig { id: ac7d45a6-6a46-4821-ae4f-411c04fbfe89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aebe7f17-44ca-41b8-87cd-232e0d2cb881 (dataset): DatasetConfig { id: aebe7f17-44ca-41b8-87cd-232e0d2cb881 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1951995-1e9f-4ca9-845a-91110670dd47 (dataset): DatasetConfig { id: b1951995-1e9f-4ca9-845a-91110670dd47 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5d5794d-80d4-4873-aab0-0646e9d80e02 (dataset): DatasetConfig { id: b5d5794d-80d4-4873-aab0-0646e9d80e02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b69cc6a4-f32d-4b83-a476-166e54fa8280 (dataset): DatasetConfig { id: b69cc6a4-f32d-4b83-a476-166e54fa8280 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b6a9e147-16ef-4a52-aa14-e032108a7490 (dataset): DatasetConfig { id: b6a9e147-16ef-4a52-aa14-e032108a7490 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6f413e2-38a2-443b-9312-2118e91cc94a (dataset): DatasetConfig { id: c6f413e2-38a2-443b-9312-2118e91cc94a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c764c2f7-4948-4aa9-bae6-6d8d1ebe4fa6 (dataset): DatasetConfig { id: c764c2f7-4948-4aa9-bae6-6d8d1ebe4fa6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c869c282-a690-474b-8586-37b3466776a7 (dataset): DatasetConfig { id: c869c282-a690-474b-8586-37b3466776a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2abd51b-f3fe-4ee1-b356-6ad0d9e97fe1 (dataset): DatasetConfig { id: d2abd51b-f3fe-4ee1-b356-6ad0d9e97fe1 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d37e6e6b-f215-4db3-99ac-e168f55f76b4 (dataset): DatasetConfig { id: d37e6e6b-f215-4db3-99ac-e168f55f76b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5e6815e-f4bc-439f-9faa-61c2585ec9a4 (dataset): DatasetConfig { id: d5e6815e-f4bc-439f-9faa-61c2585ec9a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de144bf4-c5b0-4e83-886b-7c0a73498c3d (dataset): DatasetConfig { id: de144bf4-c5b0-4e83-886b-7c0a73498c3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e182243f-d4b8-44c7-a526-085ea9f17df2 (dataset): DatasetConfig { id: e182243f-d4b8-44c7-a526-085ea9f17df2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1e4825b-63d2-4a03-b849-c839d1fd3bc2 (dataset): DatasetConfig { id: e1e4825b-63d2-4a03-b849-c839d1fd3bc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed9172c0-f5c2-4099-b891-fe6cbc01351e (dataset): DatasetConfig { id: ed9172c0-f5c2-4099-b891-fe6cbc01351e (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0f7ccc7-ada5-49cc-b1cc-67e5b96499cf (dataset): DatasetConfig { id: f0f7ccc7-ada5-49cc-b1cc-67e5b96499cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f1708b67-a3ac-4c9d-b10d-f01a6a72f578 (dataset): DatasetConfig { id: f1708b67-a3ac-4c9d-b10d-f01a6a72f578 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2afbb49-dbda-4118-bbe7-41d33806bad5 (dataset): DatasetConfig { id: f2afbb49-dbda-4118-bbe7-41d33806bad5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb2fb565-04cd-47b6-9674-dbdf67506e42 (dataset): DatasetConfig { id: fb2fb565-04cd-47b6-9674-dbdf67506e42 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbd3e082-d58f-4829-adb4-f9cd2346ee37 (dataset): DatasetConfig { id: fbd3e082-d58f-4829-adb4-f9cd2346ee37 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff5b7aa7-69af-4417-ae02-ded5b39157bc (dataset): DatasetConfig { id: ff5b7aa7-69af-4417-ae02-ded5b39157bc (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffd4acd5-a549-4eb8-b7af-4c98f9b1cf57 (dataset): DatasetConfig { id: ffd4acd5-a549-4eb8-b7af-4c98f9b1cf57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4472025-01-09T01:53:26.916ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33874
4482025-01-09T01:53:26.916ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:859 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4492025-01-09T01:53:26.916ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {032928e1-58f5-41b4-a2a6-59dbbfd42021 (dataset): DatasetConfig { id: 032928e1-58f5-41b4-a2a6-59dbbfd42021 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 05306e31-fdc2-4e88-83e1-77c796ac17af (dataset): DatasetConfig { id: 05306e31-fdc2-4e88-83e1-77c796ac17af (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 05abc4ea-4f65-425f-9f5e-210dbc28824e (dataset): DatasetConfig { id: 05abc4ea-4f65-425f-9f5e-210dbc28824e (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 07e6751f-b391-4d3e-bbc9-d1c53b78e241 (dataset): DatasetConfig { id: 07e6751f-b391-4d3e-bbc9-d1c53b78e241 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10966838-46ab-44a2-8409-3af4f56d432a (dataset): DatasetConfig { id: 10966838-46ab-44a2-8409-3af4f56d432a (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10c3352e-b4e3-4032-afe1-f11d10119b1c (dataset): DatasetConfig { id: 10c3352e-b4e3-4032-afe1-f11d10119b1c (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1235d8ab-2900-460c-8d36-967fdbae7d2b (dataset): DatasetConfig { id: 1235d8ab-2900-460c-8d36-967fdbae7d2b (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1813d753-1306-4957-8c53-90269554929b (dataset): DatasetConfig { id: 1813d753-1306-4957-8c53-90269554929b (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18c133e4-7e1a-4ac1-a417-f9e870dccea8 (dataset): DatasetConfig { id: 18c133e4-7e1a-4ac1-a417-f9e870dccea8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1ca3416b-82c6-42ac-890e-84875d455354 (dataset): DatasetConfig { id: 1ca3416b-82c6-42ac-890e-84875d455354 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f7efcec-8e97-4e30-9fd6-3ef0089995e7 (dataset): DatasetConfig { id: 1f7efcec-8e97-4e30-9fd6-3ef0089995e7 (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 238df78b-f436-4186-83c8-8a0556c326ae (dataset): DatasetConfig { id: 238df78b-f436-4186-83c8-8a0556c326ae (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2987b6f2-74c6-4bc1-874a-2c165cac19c0 (dataset): DatasetConfig { id: 2987b6f2-74c6-4bc1-874a-2c165cac19c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c5061da-0600-4cee-8949-67cb945e6e64 (dataset): DatasetConfig { id: 2c5061da-0600-4cee-8949-67cb945e6e64 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35bd2eb2-6a74-4703-ab15-fa317565bf8e (dataset): DatasetConfig { id: 35bd2eb2-6a74-4703-ab15-fa317565bf8e (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 407d80ee-8e31-429d-81ac-24c3d746c9ed (dataset): DatasetConfig { id: 407d80ee-8e31-429d-81ac-24c3d746c9ed (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 42aff64c-9167-430e-a70d-9a178d20fcd1 (dataset): DatasetConfig { id: 42aff64c-9167-430e-a70d-9a178d20fcd1 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 46a65cfa-991f-4084-b81f-66e7b560511c (dataset): DatasetConfig { id: 46a65cfa-991f-4084-b81f-66e7b560511c (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ba82607-7a4b-4f88-8409-2806eb129b75 (dataset): DatasetConfig { id: 4ba82607-7a4b-4f88-8409-2806eb129b75 (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4c0f2a4b-eb52-4881-ad52-26f252d90da8 (dataset): DatasetConfig { id: 4c0f2a4b-eb52-4881-ad52-26f252d90da8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4ce9cec4-507b-4a8b-a6c7-353793218388 (dataset): DatasetConfig { id: 4ce9cec4-507b-4a8b-a6c7-353793218388 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4e4c9b87-04bb-4a39-b18d-9747e96a77ec (dataset): DatasetConfig { id: 4e4c9b87-04bb-4a39-b18d-9747e96a77ec (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 50f18f6f-8a11-43f4-a3ab-0b632010ee66 (dataset): DatasetConfig { id: 50f18f6f-8a11-43f4-a3ab-0b632010ee66 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 59f71c02-1039-441f-b762-7935832968e3 (dataset): DatasetConfig { id: 59f71c02-1039-441f-b762-7935832968e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c4b83a1-6426-42a7-b8f5-51dca334ddfc (dataset): DatasetConfig { id: 5c4b83a1-6426-42a7-b8f5-51dca334ddfc (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 5e6d97c6-cdbf-4a67-9330-34a0c3519d8c (dataset): DatasetConfig { id: 5e6d97c6-cdbf-4a67-9330-34a0c3519d8c (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 66fa9d22-a640-4982-8055-6106b0f5275f (dataset): DatasetConfig { id: 66fa9d22-a640-4982-8055-6106b0f5275f (dataset), name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6aae9f38-4844-48bc-94cb-0b3804ffb447 (dataset): DatasetConfig { id: 6aae9f38-4844-48bc-94cb-0b3804ffb447 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b1f8dd2-293a-4eb8-9dcb-09ff90598fce (dataset): DatasetConfig { id: 6b1f8dd2-293a-4eb8-9dcb-09ff90598fce (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6b3bf21b-334b-47cf-80a9-29095ba59c19 (dataset): DatasetConfig { id: 6b3bf21b-334b-47cf-80a9-29095ba59c19 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6cb1176b-1c0b-491f-92ad-ba6c62e5991e (dataset): DatasetConfig { id: 6cb1176b-1c0b-491f-92ad-ba6c62e5991e (dataset), name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6dba5718-fad2-46a5-9133-f8d5c1884eba (dataset): DatasetConfig { id: 6dba5718-fad2-46a5-9133-f8d5c1884eba (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 790a7d2f-fec4-4d33-b391-ed8477f2c62d (dataset): DatasetConfig { id: 790a7d2f-fec4-4d33-b391-ed8477f2c62d (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7d433762-f1dd-4ef3-8d13-1c78801b82a3 (dataset): DatasetConfig { id: 7d433762-f1dd-4ef3-8d13-1c78801b82a3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 853a33aa-4891-4501-807c-5730c2761ef1 (dataset): DatasetConfig { id: 853a33aa-4891-4501-807c-5730c2761ef1 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 88775654-46ad-4998-84fb-33143290ca5e (dataset): DatasetConfig { id: 88775654-46ad-4998-84fb-33143290ca5e (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 892989de-d926-4357-8f52-1e1aeb5e4548 (dataset): DatasetConfig { id: 892989de-d926-4357-8f52-1e1aeb5e4548 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8f46375e-ce50-4687-9e37-2298f522f716 (dataset): DatasetConfig { id: 8f46375e-ce50-4687-9e37-2298f522f716 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 92be3047-5909-46b4-8057-d4a3410fd04f (dataset): DatasetConfig { id: 92be3047-5909-46b4-8057-d4a3410fd04f (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a6d2f8b0-1e71-449f-9f59-52da53aa9054 (dataset): DatasetConfig { id: a6d2f8b0-1e71-449f-9f59-52da53aa9054 (dataset), name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a73d8502-d4cc-4798-a227-9c3991b7bb7d (dataset): DatasetConfig { id: a73d8502-d4cc-4798-a227-9c3991b7bb7d (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, a8c419aa-94bf-45ca-9e55-fc5327df75e3 (dataset): DatasetConfig { id: a8c419aa-94bf-45ca-9e55-fc5327df75e3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a8ec726c-a244-4a9d-b61e-448ce85525be (dataset): DatasetConfig { id: a8ec726c-a244-4a9d-b61e-448ce85525be (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ac7d45a6-6a46-4821-ae4f-411c04fbfe89 (dataset): DatasetConfig { id: ac7d45a6-6a46-4821-ae4f-411c04fbfe89 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, aebe7f17-44ca-41b8-87cd-232e0d2cb881 (dataset): DatasetConfig { id: aebe7f17-44ca-41b8-87cd-232e0d2cb881 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b1951995-1e9f-4ca9-845a-91110670dd47 (dataset): DatasetConfig { id: b1951995-1e9f-4ca9-845a-91110670dd47 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b5d5794d-80d4-4873-aab0-0646e9d80e02 (dataset): DatasetConfig { id: b5d5794d-80d4-4873-aab0-0646e9d80e02 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b69cc6a4-f32d-4b83-a476-166e54fa8280 (dataset): DatasetConfig { id: b69cc6a4-f32d-4b83-a476-166e54fa8280 (dataset), name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b6a9e147-16ef-4a52-aa14-e032108a7490 (dataset): DatasetConfig { id: b6a9e147-16ef-4a52-aa14-e032108a7490 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c6f413e2-38a2-443b-9312-2118e91cc94a (dataset): DatasetConfig { id: c6f413e2-38a2-443b-9312-2118e91cc94a (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c764c2f7-4948-4aa9-bae6-6d8d1ebe4fa6 (dataset): DatasetConfig { id: c764c2f7-4948-4aa9-bae6-6d8d1ebe4fa6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c869c282-a690-474b-8586-37b3466776a7 (dataset): DatasetConfig { id: c869c282-a690-474b-8586-37b3466776a7 (dataset), name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d2abd51b-f3fe-4ee1-b356-6ad0d9e97fe1 (dataset): DatasetConfig { id: d2abd51b-f3fe-4ee1-b356-6ad0d9e97fe1 (dataset), name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d37e6e6b-f215-4db3-99ac-e168f55f76b4 (dataset): DatasetConfig { id: d37e6e6b-f215-4db3-99ac-e168f55f76b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d5e6815e-f4bc-439f-9faa-61c2585ec9a4 (dataset): DatasetConfig { id: d5e6815e-f4bc-439f-9faa-61c2585ec9a4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, de144bf4-c5b0-4e83-886b-7c0a73498c3d (dataset): DatasetConfig { id: de144bf4-c5b0-4e83-886b-7c0a73498c3d (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e182243f-d4b8-44c7-a526-085ea9f17df2 (dataset): DatasetConfig { id: e182243f-d4b8-44c7-a526-085ea9f17df2 (dataset), name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1e4825b-63d2-4a03-b849-c839d1fd3bc2 (dataset): DatasetConfig { id: e1e4825b-63d2-4a03-b849-c839d1fd3bc2 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ed9172c0-f5c2-4099-b891-fe6cbc01351e (dataset): DatasetConfig { id: ed9172c0-f5c2-4099-b891-fe6cbc01351e (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f0f7ccc7-ada5-49cc-b1cc-67e5b96499cf (dataset): DatasetConfig { id: f0f7ccc7-ada5-49cc-b1cc-67e5b96499cf (dataset), name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, f1708b67-a3ac-4c9d-b10d-f01a6a72f578 (dataset): DatasetConfig { id: f1708b67-a3ac-4c9d-b10d-f01a6a72f578 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2afbb49-dbda-4118-bbe7-41d33806bad5 (dataset): DatasetConfig { id: f2afbb49-dbda-4118-bbe7-41d33806bad5 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fb2fb565-04cd-47b6-9674-dbdf67506e42 (dataset): DatasetConfig { id: fb2fb565-04cd-47b6-9674-dbdf67506e42 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fbd3e082-d58f-4829-adb4-f9cd2346ee37 (dataset): DatasetConfig { id: fbd3e082-d58f-4829-adb4-f9cd2346ee37 (dataset), name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ff5b7aa7-69af-4417-ae02-ded5b39157bc (dataset): DatasetConfig { id: ff5b7aa7-69af-4417-ae02-ded5b39157bc (dataset), name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ffd4acd5-a549-4eb8-b7af-4c98f9b1cf57 (dataset): DatasetConfig { id: ffd4acd5-a549-4eb8-b7af-4c98f9b1cf57 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4502025-01-09T01:53:26.918ZINFOSledAgent (StorageManager): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4512025-01-09T01:53:26.918ZINFOSledAgent (StorageManager): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4522025-01-09T01:53:26.918ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4532025-01-09T01:53:26.930ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542025-01-09T01:53:26.930ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4552025-01-09T01:53:26.930ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/debug"), full_name: "oxp_e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/debug" } file = sled-storage/src/manager.rs:1431
4562025-01-09T01:53:26.961ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572025-01-09T01:53:26.961ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582025-01-09T01:53:26.961ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crucible" } file = sled-storage/src/manager.rs:1431
4592025-01-09T01:53:27.009ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602025-01-09T01:53:27.009ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612025-01-09T01:53:27.009ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3/crucible" } file = sled-storage/src/manager.rs:1431
4622025-01-09T01:53:27.057ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632025-01-09T01:53:27.057ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4642025-01-09T01:53:27.057ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4652025-01-09T01:53:27.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662025-01-09T01:53:27.107ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4672025-01-09T01:53:27.107ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crucible" } file = sled-storage/src/manager.rs:1431
4682025-01-09T01:53:27.153ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692025-01-09T01:53:27.153ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702025-01-09T01:53:27.153ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6f3f94ab-1776-457a-b887-7085a2c11828/crypt/zone/oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc"), full_name: "oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crypt/zone/oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc" } file = sled-storage/src/manager.rs:1431
4712025-01-09T01:53:27.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722025-01-09T01:53:27.212ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4732025-01-09T01:53:27.212ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4742025-01-09T01:53:27.260ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752025-01-09T01:53:27.260ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762025-01-09T01:53:27.260ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6f3f94ab-1776-457a-b887-7085a2c11828/crypt/zone/oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6"), full_name: "oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crypt/zone/oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6" } file = sled-storage/src/manager.rs:1431
4772025-01-09T01:53:27.319ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4782025-01-09T01:53:27.319ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4792025-01-09T01:53:27.319ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6f3f94ab-1776-457a-b887-7085a2c11828/crypt/zone"), full_name: "oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crypt/zone" } file = sled-storage/src/manager.rs:1431
4802025-01-09T01:53:27.347ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4812025-01-09T01:53:27.347ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4822025-01-09T01:53:27.347ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c" } file = sled-storage/src/manager.rs:1431
4832025-01-09T01:53:27.404ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4842025-01-09T01:53:27.404ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4852025-01-09T01:53:27.404ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/zone/oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68"), full_name: "oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/zone/oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68" } file = sled-storage/src/manager.rs:1431
4862025-01-09T01:53:27.464ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4872025-01-09T01:53:27.464ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4882025-01-09T01:53:27.464ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/zone/oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea"), full_name: "oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/zone/oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea" } file = sled-storage/src/manager.rs:1431
4892025-01-09T01:53:27.524ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4902025-01-09T01:53:27.524ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4912025-01-09T01:53:27.524ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/zone/oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c"), full_name: "oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/zone/oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c" } file = sled-storage/src/manager.rs:1431
4922025-01-09T01:53:27.581ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4932025-01-09T01:53:27.581ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4942025-01-09T01:53:27.581ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4952025-01-09T01:53:27.628ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4962025-01-09T01:53:27.628ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4972025-01-09T01:53:27.628ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/zone/oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d"), full_name: "oxp_e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/zone/oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d" } file = sled-storage/src/manager.rs:1431
4982025-01-09T01:53:27.685ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6fecef6-14a9-49d3-a8bb-39ae9e1483bd) file = sled-agent/src/probe_manager.rs:231 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
4992025-01-09T01:53:27.687ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002025-01-09T01:53:27.687ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5012025-01-09T01:53:27.687ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crucible" } file = sled-storage/src/manager.rs:1431
5022025-01-09T01:53:27.733ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032025-01-09T01:53:27.733ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5042025-01-09T01:53:27.733ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/zone/oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d"), full_name: "oxp_e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/zone/oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d" } file = sled-storage/src/manager.rs:1431
5052025-01-09T01:53:27.790ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062025-01-09T01:53:27.790ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5072025-01-09T01:53:27.790ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crucible" } file = sled-storage/src/manager.rs:1431
5082025-01-09T01:53:27.838ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092025-01-09T01:53:27.838ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5102025-01-09T01:53:27.838ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/zone"), full_name: "oxp_e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/zone" } file = sled-storage/src/manager.rs:1431
5112025-01-09T01:53:27.866ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122025-01-09T01:53:27.866ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5132025-01-09T01:53:27.866ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c" } file = sled-storage/src/manager.rs:1431
5142025-01-09T01:53:27.925ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152025-01-09T01:53:27.925ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5162025-01-09T01:53:27.925ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5172025-01-09T01:53:27.976ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182025-01-09T01:53:27.976ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5192025-01-09T01:53:27.976ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/debug"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/debug" } file = sled-storage/src/manager.rs:1431
5202025-01-09T01:53:28.006ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212025-01-09T01:53:28.006ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5222025-01-09T01:53:28.006ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5232025-01-09T01:53:28.057ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242025-01-09T01:53:28.057ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252025-01-09T01:53:28.057ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6f3f94ab-1776-457a-b887-7085a2c11828/crypt/zone/oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13"), full_name: "oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crypt/zone/oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13" } file = sled-storage/src/manager.rs:1431
5262025-01-09T01:53:28.119ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272025-01-09T01:53:28.119ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5282025-01-09T01:53:28.119ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/debug"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/debug" } file = sled-storage/src/manager.rs:1431
5292025-01-09T01:53:28.147ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302025-01-09T01:53:28.147ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5312025-01-09T01:53:28.147ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_e3b35f00-104f-4cfc-b343-844e77de82c6/crucible" } file = sled-storage/src/manager.rs:1431
5322025-01-09T01:53:28.196ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-01-09T01:53:28.196ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5342025-01-09T01:53:28.196ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b22ab4ae-5a19-4667-afb0-e2711a470b13/crypt/debug"), full_name: "oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13/crypt/debug" } file = sled-storage/src/manager.rs:1431
5352025-01-09T01:53:28.224ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-01-09T01:53:28.224ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5372025-01-09T01:53:28.224ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5382025-01-09T01:53:28.278ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-01-09T01:53:28.278ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402025-01-09T01:53:28.278ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/zone/oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05"), full_name: "oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/zone/oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05" } file = sled-storage/src/manager.rs:1431
5412025-01-09T01:53:28.337ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5422025-01-09T01:53:28.337ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5432025-01-09T01:53:28.337ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/zone/oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36"), full_name: "oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/zone/oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36" } file = sled-storage/src/manager.rs:1431
5442025-01-09T01:53:28.399ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5452025-01-09T01:53:28.400ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5462025-01-09T01:53:28.400ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/zone/oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d"), full_name: "oxp_e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/zone/oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d" } file = sled-storage/src/manager.rs:1431
5472025-01-09T01:53:28.459ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5482025-01-09T01:53:28.460ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5492025-01-09T01:53:28.460ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5" } file = sled-storage/src/manager.rs:1431
5502025-01-09T01:53:28.519ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5512025-01-09T01:53:28.520ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5522025-01-09T01:53:28.520ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/zone/oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), full_name: "oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/zone/oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b" } file = sled-storage/src/manager.rs:1431
5532025-01-09T01:53:28.580ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5542025-01-09T01:53:28.580ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5552025-01-09T01:53:28.580ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/zone"), full_name: "oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/zone" } file = sled-storage/src/manager.rs:1431
5562025-01-09T01:53:28.609ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5572025-01-09T01:53:28.609ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5582025-01-09T01:53:28.609ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/debug"), full_name: "oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/debug" } file = sled-storage/src/manager.rs:1431
5592025-01-09T01:53:28.638ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5602025-01-09T01:53:28.638ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5612025-01-09T01:53:28.638ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone" } file = sled-storage/src/manager.rs:1431
5622025-01-09T01:53:28.668ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5632025-01-09T01:53:28.668ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5642025-01-09T01:53:28.668ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963/crucible" } file = sled-storage/src/manager.rs:1431
5652025-01-09T01:53:28.688ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6fecef6-14a9-49d3-a8bb-39ae9e1483bd) file = sled-agent/src/probe_manager.rs:231 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
5662025-01-09T01:53:28.716ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672025-01-09T01:53:28.716ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5682025-01-09T01:53:28.716ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone" } file = sled-storage/src/manager.rs:1431
5692025-01-09T01:53:28.745ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702025-01-09T01:53:28.745ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5712025-01-09T01:53:28.745ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/zone/oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349"), full_name: "oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/zone/oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349" } file = sled-storage/src/manager.rs:1431
5722025-01-09T01:53:28.808ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732025-01-09T01:53:28.808ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742025-01-09T01:53:28.808ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b22ab4ae-5a19-4667-afb0-e2711a470b13/crypt/zone/oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8"), full_name: "oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13/crypt/zone/oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8" } file = sled-storage/src/manager.rs:1431
5752025-01-09T01:53:28.869ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762025-01-09T01:53:28.869ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5772025-01-09T01:53:28.869ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/debug"), full_name: "oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/debug" } file = sled-storage/src/manager.rs:1431
5782025-01-09T01:53:28.898ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-01-09T01:53:28.898ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802025-01-09T01:53:28.898ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412" } file = sled-storage/src/manager.rs:1431
5812025-01-09T01:53:28.959ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822025-01-09T01:53:28.959ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5832025-01-09T01:53:28.959ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/zone"), full_name: "oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/zone" } file = sled-storage/src/manager.rs:1431
5842025-01-09T01:53:28.988ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852025-01-09T01:53:28.988ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862025-01-09T01:53:28.988ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5872025-01-09T01:53:29.040ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882025-01-09T01:53:29.040ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892025-01-09T01:53:29.040ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5902025-01-09T01:53:29.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912025-01-09T01:53:29.090ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5922025-01-09T01:53:29.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5932025-01-09T01:53:29.139ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-01-09T01:53:29.139ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5952025-01-09T01:53:29.139ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80" } file = sled-storage/src/manager.rs:1431
5962025-01-09T01:53:29.199ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-01-09T01:53:29.199ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5982025-01-09T01:53:29.199ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/debug"), full_name: "oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/debug" } file = sled-storage/src/manager.rs:1431
5992025-01-09T01:53:29.230ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002025-01-09T01:53:29.230ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6012025-01-09T01:53:29.230ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/zone/oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4"), full_name: "oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/zone/oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4" } file = sled-storage/src/manager.rs:1431
6022025-01-09T01:53:29.289ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6032025-01-09T01:53:29.289ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6042025-01-09T01:53:29.289ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33" } file = sled-storage/src/manager.rs:1431
6052025-01-09T01:53:29.352ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6062025-01-09T01:53:29.353ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6072025-01-09T01:53:29.353ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd" } file = sled-storage/src/manager.rs:1431
6082025-01-09T01:53:29.415ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6092025-01-09T01:53:29.415ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6102025-01-09T01:53:29.415ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13/crucible" } file = sled-storage/src/manager.rs:1431
6112025-01-09T01:53:29.465ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6122025-01-09T01:53:29.465ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6132025-01-09T01:53:29.465ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/zone"), full_name: "oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/zone" } file = sled-storage/src/manager.rs:1431
6142025-01-09T01:53:29.484ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 17.246817439s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
6152025-01-09T01:53:29.494ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-01-09T01:53:29.494ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172025-01-09T01:53:29.494ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6182025-01-09T01:53:29.545ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-01-09T01:53:29.545ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202025-01-09T01:53:29.545ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/zone/oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e" } file = sled-storage/src/manager.rs:1431
6212025-01-09T01:53:29.605ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-01-09T01:53:29.605ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232025-01-09T01:53:29.605ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22" } file = sled-storage/src/manager.rs:1431
6242025-01-09T01:53:29.665ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-01-09T01:53:29.665ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6262025-01-09T01:53:29.665ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b22ab4ae-5a19-4667-afb0-e2711a470b13/crypt/zone"), full_name: "oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13/crypt/zone" } file = sled-storage/src/manager.rs:1431
6272025-01-09T01:53:29.689ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6fecef6-14a9-49d3-a8bb-39ae9e1483bd) file = sled-agent/src/probe_manager.rs:231 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
6282025-01-09T01:53:29.693ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-01-09T01:53:29.693ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302025-01-09T01:53:29.693ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crucible" } file = sled-storage/src/manager.rs:1431
6312025-01-09T01:53:29.741ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-01-09T01:53:29.741ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332025-01-09T01:53:29.741ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/zone/oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677"), full_name: "oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/zone/oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677" } file = sled-storage/src/manager.rs:1431
6342025-01-09T01:53:29.802ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-01-09T01:53:29.802ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6362025-01-09T01:53:29.802ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/6f3f94ab-1776-457a-b887-7085a2c11828/crypt/debug"), full_name: "oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crypt/debug" } file = sled-storage/src/manager.rs:1431
6372025-01-09T01:53:29.830ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-01-09T01:53:29.830ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-01-09T01:53:29.831ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6402025-01-09T01:53:29.881ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-01-09T01:53:29.881ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-01-09T01:53:29.881ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526" } file = sled-storage/src/manager.rs:1431
6432025-01-09T01:53:29.940ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-01-09T01:53:29.940ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452025-01-09T01:53:29.940ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/zone/oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da"), full_name: "oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/zone/oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da" } file = sled-storage/src/manager.rs:1431
6462025-01-09T01:53:30.000ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-01-09T01:53:30.000ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6482025-01-09T01:53:30.000ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/debug"), full_name: "oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/debug" } file = sled-storage/src/manager.rs:1431
6492025-01-09T01:53:30.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6502025-01-09T01:53:30.031ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6512025-01-09T01:53:30.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/zone"), full_name: "oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/zone" } file = sled-storage/src/manager.rs:1431
6522025-01-09T01:53:30.063ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6532025-01-09T01:53:30.063ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6542025-01-09T01:53:30.063ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78"), full_name: "oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/zone/oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78" } file = sled-storage/src/manager.rs:1431
6552025-01-09T01:53:30.124ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6562025-01-09T01:53:30.124ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6572025-01-09T01:53:30.124ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:861 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
6582025-01-09T01:53:30.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3208989 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33874 req_id = ed698ef5-b1c3-4577-a2a2-c1ae9c73345b response_code = 200 uri = /datasets
6592025-01-09T01:53:30.156ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 573d190f-b843-4bac-93a9-39d7c33ed06c (service), filesystem_pool: Some(ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 808bb178-f8c3-48a5-811c-1b9a0998de13 (service), filesystem_pool: Some(ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6602025-01-09T01:53:30.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41613
6612025-01-09T01:53:30.156ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6622025-01-09T01:53:30.156ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, responder: ... }
6632025-01-09T01:53:30.166ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6642025-01-09T01:53:30.166ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6652025-01-09T01:53:30.175ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6662025-01-09T01:53:30.175ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6672025-01-09T01:53:30.183ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-09T01:53:30.183ZINFOSledAgent (ServiceManager): No ledger in /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:188
6692025-01-09T01:53:30.183ZINFOSledAgent (ServiceManager): No ledger in /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:188
6702025-01-09T01:53:30.183ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6712025-01-09T01:53:30.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6722025-01-09T01:53:30.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6732025-01-09T01:53:30.228ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6742025-01-09T01:53:30.239ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4507
6752025-01-09T01:53:30.239ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4353
6762025-01-09T01:53:30.286ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5 file = illumos-utils/src/zone.rs:325
6772025-01-09T01:53:30.289ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c file = illumos-utils/src/zone.rs:325
6782025-01-09T01:53:30.293ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13 file = illumos-utils/src/zone.rs:325
6792025-01-09T01:53:30.306ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5 file = illumos-utils/src/zone.rs:363
6802025-01-09T01:53:30.310ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c file = illumos-utils/src/zone.rs:363
6812025-01-09T01:53:30.314ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13 file = illumos-utils/src/zone.rs:363
6822025-01-09T01:53:30.692ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/e6fecef6-14a9-49d3-a8bb-39ae9e1483bd) file = sled-agent/src/probe_manager.rs:231 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
6832025-01-09T01:53:31.924ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6842025-01-09T01:53:31.924ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6852025-01-09T01:53:32.299ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4395
6862025-01-09T01:53:32.299ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4474 rack_subnet = fd00:1122:3344::
6872025-01-09T01:53:32.319ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4485
6882025-01-09T01:53:32.319ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4527
6892025-01-09T01:53:32.380ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4559
6902025-01-09T01:53:32.380ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4565
6912025-01-09T01:53:32.394ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12960981815080797936 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
6922025-01-09T01:53:32.394ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9730199486609037253 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
6932025-01-09T01:53:32.408ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6942025-01-09T01:53:32.474ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4606
6952025-01-09T01:53:32.474ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
6962025-01-09T01:53:32.745ZWARNSledAgent (ServiceManager): Failed to get switch ID from MGS (retrying in 65.985681ms) error = Communication Error: error sending request for url (http://[fd00:1122:3344:101::2]:12225/local/switch-id) file = sled-agent/src/bootstrap/early_networking.rs:389
6972025-01-09T01:53:32.813ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
6982025-01-09T01:53:32.845ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
6992025-01-09T01:53:32.845ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7002025-01-09T01:53:32.846ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 0
7012025-01-09T01:53:32.846ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7022025-01-09T01:53:32.890ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
7032025-01-09T01:53:32.890ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7042025-01-09T01:53:32.890ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7052025-01-09T01:53:32.894ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
7062025-01-09T01:53:32.897ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
7072025-01-09T01:53:32.897ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7082025-01-09T01:53:32.902ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7092025-01-09T01:53:32.950ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7102025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7112025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7122025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7132025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7142025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7152025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7162025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7172025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7182025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7192025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7202025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7212025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7222025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7232025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7242025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7252025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7262025-01-09T01:53:32.950ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7272025-01-09T01:53:32.951ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7282025-01-09T01:53:32.951ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7292025-01-09T01:53:32.951ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7302025-01-09T01:53:32.951ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7312025-01-09T01:53:32.951ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7322025-01-09T01:53:33.035ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5") failed: Property not found. retry in 26.188431ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7332025-01-09T01:53:33.041ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c") failed: Property not found. retry in 69.37267ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7342025-01-09T01:53:33.048ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13") failed: Property not found. retry in 69.311486ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7352025-01-09T01:53:33.069ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5") failed: Property not found. retry in 79.453126ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7362025-01-09T01:53:33.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c") failed: Property not found. retry in 126.668587ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7372025-01-09T01:53:33.423ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13") failed: Property not found. retry in 89.212094ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7382025-01-09T01:53:33.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5") failed: Property not found. retry in 207.698793ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7392025-01-09T01:53:33.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c") failed: Property not found. retry in 187.634427ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7402025-01-09T01:53:33.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13") failed: Property not found. retry in 285.030148ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7412025-01-09T01:53:33.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5") failed: Property not found. retry in 462.913543ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7422025-01-09T01:53:33.717ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c") failed: Property not found. retry in 428.938629ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7432025-01-09T01:53:33.824ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7956359473525979411 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
7442025-01-09T01:53:33.824ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5240800129435882753 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
7452025-01-09T01:53:33.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13") failed: Property not found. retry in 477.8879ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7462025-01-09T01:53:34.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c") failed: Property not found. retry in 996.351898ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7472025-01-09T01:53:34.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5") failed: Property not found. retry in 776.854825ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7482025-01-09T01:53:34.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13") failed: Property not found. retry in 1.036981076s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7492025-01-09T01:53:34.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5") failed: Property not found. retry in 1.357287312s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7502025-01-09T01:53:35.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c") failed: Property not found. retry in 750.230644ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7512025-01-09T01:53:35.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13") failed: Property not found. retry in 1.117975649s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7522025-01-09T01:53:35.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c") failed: Property not found. retry in 1.439328764s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7532025-01-09T01:53:36.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5") failed: Property not found. retry in 1.014492066s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7542025-01-09T01:53:36.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13") failed: Property not found. retry in 794.181345ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7552025-01-09T01:53:37.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13") failed: Property not found. retry in 1.269377638s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7562025-01-09T01:53:37.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5") failed: Property not found. retry in 1.122689162s file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7572025-01-09T01:53:37.365ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c") failed: Property not found. retry in 755.715635ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7582025-01-09T01:53:38.130ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c") failed: Property not found. retry in 648.933435ms file = illumos-utils/src/svc.rs:36 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7592025-01-09T01:53:38.797ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5
7602025-01-09T01:53:38.797ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_573d190f-b843-4bac-93a9-39d7c33ed06c
7612025-01-09T01:53:38.797ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_internal_dns_808bb178-f8c3-48a5-811c-1b9a0998de13
7622025-01-09T01:53:38.797ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7632025-01-09T01:53:38.797ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642025-01-09T01:53:38.798ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8641537 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:41613 req_id = 53e589c9-b3e1-435f-9110-f730e9b3f62f response_code = 204 uri = /omicron-zones
7652025-01-09T01:53:38.800ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7662025-01-09T01:53:39.173ZWARNSledAgent (RSS): failed to write DNS configuration (will retry in 125.698922ms) dns_config_addr = [fd00:1122:3344:1::1]:5353 error_message = Communication Error: error sending request for url (http://[fd00:1122:3344:1::1]:5353/config) file = sled-agent/src/rack_setup/service.rs:678
7672025-01-09T01:53:39.317ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7682025-01-09T01:53:39.365ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7692025-01-09T01:53:39.430ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7702025-01-09T01:53:39.430ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7712025-01-09T01:53:39.462ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7722025-01-09T01:53:39.463ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7732025-01-09T01:53:39.463ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7742025-01-09T01:53:39.492ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 573d190f-b843-4bac-93a9-39d7c33ed06c (service), filesystem_pool: Some(ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 808bb178-f8c3-48a5-811c-1b9a0998de13 (service), filesystem_pool: Some(ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: bb4806b3-02bb-4f7d-a237-507a255e6c22 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 818ff4df-a4e3-40a7-ad8a-b60340e4ed5b, kind: Service { id: bb4806b3-02bb-4f7d-a237-507a255e6c22 }, name: Name("ntp-bb4806b3-02bb-4f7d-a237-507a255e6c22"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 177])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7752025-01-09T01:53:39.492ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54504
7762025-01-09T01:53:39.492ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7772025-01-09T01:53:39.492ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, responder: ... }
7782025-01-09T01:53:39.502ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7792025-01-09T01:53:39.503ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7802025-01-09T01:53:39.513ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7812025-01-09T01:53:39.513ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7822025-01-09T01:53:39.523ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7832025-01-09T01:53:39.523ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:177
7842025-01-09T01:53:39.523ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:177
7852025-01-09T01:53:39.523ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7862025-01-09T01:53:39.534ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7872025-01-09T01:53:39.566ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7882025-01-09T01:53:39.566ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7892025-01-09T01:53:39.566ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7902025-01-09T01:53:39.596ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 209, 177]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7912025-01-09T01:53:39.596ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = boundary_ntp
7922025-01-09T01:53:39.596ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7932025-01-09T01:53:39.596ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7942025-01-09T01:53:39.597ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7952025-01-09T01:53:39.597ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7962025-01-09T01:53:39.622ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22 file = illumos-utils/src/zone.rs:325
7972025-01-09T01:53:39.640ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22 file = illumos-utils/src/zone.rs:363
7982025-01-09T01:53:40.250ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7992025-01-09T01:53:40.251ZINFOSledAgent (ServiceManager): Booting oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8002025-01-09T01:53:40.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 43.602037ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8012025-01-09T01:53:40.435ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 83.69243ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8022025-01-09T01:53:40.530ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 269.316456ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8032025-01-09T01:53:40.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 359.73255ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8042025-01-09T01:53:41.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 631.790018ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8052025-01-09T01:53:41.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 685.97001ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8062025-01-09T01:53:42.396ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12960981815080797936 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8072025-01-09T01:53:42.396ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9730199486609037253 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8082025-01-09T01:53:42.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 565.531243ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8092025-01-09T01:53:43.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 582.087774ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8102025-01-09T01:53:43.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 930.077373ms file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8112025-01-09T01:53:43.825ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7956359473525979411 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8122025-01-09T01:53:43.825ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5240800129435882753 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8132025-01-09T01:53:44.624ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22") failed: Property not found. retry in 1.275576171s file = illumos-utils/src/svc.rs:36 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8142025-01-09T01:53:45.919ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22
8152025-01-09T01:53:45.919ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8162025-01-09T01:53:45.920ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8172025-01-09T01:53:45.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6428251 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:54504 req_id = 3b8c6234-591b-458b-bf14-2c3462f89018 response_code = 204 uri = /omicron-zones
8182025-01-09T01:53:45.922ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8192025-01-09T01:53:45.952ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8202025-01-09T01:53:45.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57017
8212025-01-09T01:53:45.961ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8222025-01-09T01:53:45.962ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57017 req_id = dc820948-7c8c-484e-b405-44a23942b0b3 response_code = 500 uri = /timesync
8232025-01-09T01:53:45.964ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8242025-01-09T01:53:46.073ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8252025-01-09T01:53:46.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41895
8262025-01-09T01:53:48.489ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4716784496464449782 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8272025-01-09T01:53:48.628ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10261251381515469033 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8282025-01-09T01:53:48.801ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4760046479622698213 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8292025-01-09T01:53:50.082ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8302025-01-09T01:53:50.082ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009046 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41895 req_id = a52ffa39-5c1e-488f-aefb-43dd5908ac58 response_code = 500 uri = /timesync
8312025-01-09T01:53:50.085ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8322025-01-09T01:53:50.232ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8332025-01-09T01:53:50.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37731
8342025-01-09T01:53:50.242ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8352025-01-09T01:53:50.242ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 9637 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37731 req_id = 0da166b5-047c-4c54-82f3-ebdda6752b8e response_code = 500 uri = /timesync
8362025-01-09T01:53:50.244ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8372025-01-09T01:53:50.401ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8382025-01-09T01:53:50.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36916
8392025-01-09T01:53:52.399ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12960981815080797936 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8402025-01-09T01:53:52.399ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 9730199486609037253 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8412025-01-09T01:53:54.491ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7956359473525979411 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8422025-01-09T01:53:54.491ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5240800129435882753 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8432025-01-09T01:53:55.074ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_bb4806b3-02bb-4f7d-a237-507a255e6c22': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3926
8442025-01-09T01:53:55.074ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 4009189 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:36916 req_id = 11e8c3cc-63a9-4e8e-9ba6-54b7ae712336 response_code = 500 uri = /timesync
8452025-01-09T01:53:55.076ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8462025-01-09T01:53:55.315ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8472025-01-09T01:53:55.315ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53734
8482025-01-09T01:53:55.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53734 req_id = c10930fb-638d-4278-a168-03eaf02ef465 response_code = 200 uri = /timesync
8492025-01-09T01:53:55.327ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736387634.0104864, correction: -0.062001728 } file = sled-agent/src/rack_setup/service.rs:743
8502025-01-09T01:53:55.327ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8512025-01-09T01:53:55.466ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8522025-01-09T01:53:55.466ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:50603
8532025-01-09T01:53:55.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8864 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:50603 req_id = 754ec58a-326f-440d-90ca-3563c77d94d5 response_code = 200 uri = /timesync
8542025-01-09T01:53:55.477ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736387634.0104864, correction: -0.061591484 } file = sled-agent/src/rack_setup/service.rs:743
8552025-01-09T01:53:55.477ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8562025-01-09T01:53:55.836ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8572025-01-09T01:53:55.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52255
8582025-01-09T01:53:55.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8354 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:52255 req_id = 4b7dbcf0-f52a-4816-828b-1e632a9ac039 response_code = 200 uri = /timesync
8592025-01-09T01:53:55.846ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736387634.0104864, correction: -0.060588609 } file = sled-agent/src/rack_setup/service.rs:743
8602025-01-09T01:53:55.846ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8612025-01-09T01:53:56.115ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8622025-01-09T01:53:56.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:42932
8632025-01-09T01:53:56.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:42932 req_id = 2c5a46b4-e46b-48bd-94f1-3e9369b36a72 response_code = 200 uri = /timesync
8642025-01-09T01:53:56.127ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736387634.0104864, correction: -0.064758524 } file = sled-agent/src/rack_setup/service.rs:743
8652025-01-09T01:53:56.127ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8662025-01-09T01:53:56.612ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8672025-01-09T01:53:56.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:35702
8682025-01-09T01:53:56.617ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8294568275949677303 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8692025-01-09T01:53:56.617ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1119145444702967751 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8702025-01-09T01:53:56.621ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8435 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:35702 req_id = 9cf3150d-2db0-4687-9192-111e10531319 response_code = 200 uri = /timesync
8712025-01-09T01:53:56.622ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1736387634.0104864, correction: -0.063409254 } file = sled-agent/src/rack_setup/service.rs:743
8722025-01-09T01:53:56.622ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8732025-01-09T01:53:57.116ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8742025-01-09T01:53:57.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62785
8752025-01-09T01:53:57.125ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8668 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62785 req_id = b0f79717-7a16-4359-a84c-e7ac347696bf response_code = 200 uri = /timesync
8762025-01-09T01:53:57.127ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214768833, ip_addr: 12.205.28.193, stratum: 3, ref_time: 1736387636.840397, correction: -0.065883875 } file = sled-agent/src/rack_setup/service.rs:743
8772025-01-09T01:53:57.127ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8782025-01-09T01:53:57.860ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8792025-01-09T01:53:57.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39252
8802025-01-09T01:53:57.869ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8028 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39252 req_id = 5ea76ef6-c2ac-4c6a-a166-96aa8d52a5fb response_code = 200 uri = /timesync
8812025-01-09T01:53:57.870ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214768833, ip_addr: 12.205.28.193, stratum: 3, ref_time: 1736387636.840397, correction: -0.06386476 } file = sled-agent/src/rack_setup/service.rs:743
8822025-01-09T01:53:57.870ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8832025-01-09T01:53:58.319ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8842025-01-09T01:53:58.319ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45027
8852025-01-09T01:53:58.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8858 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45027 req_id = 53d328af-8582-45d3-b106-7f729b7de37f response_code = 200 uri = /timesync
8862025-01-09T01:53:58.331ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214768833, ip_addr: 12.205.28.193, stratum: 3, ref_time: 1736387637.7058778, correction: -0.057712894 } file = sled-agent/src/rack_setup/service.rs:743
8872025-01-09T01:53:58.331ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8882025-01-09T01:53:59.108ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8892025-01-09T01:53:59.109ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51074
8902025-01-09T01:53:59.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8416 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51074 req_id = d224aa6f-2cdd-400b-98ee-1d5bdb1951a1 response_code = 200 uri = /timesync
8912025-01-09T01:53:59.119ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 214768833, ip_addr: 12.205.28.193, stratum: 3, ref_time: 1736387638.400142, correction: -0.052662093 } file = sled-agent/src/rack_setup/service.rs:743
8922025-01-09T01:53:59.119ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8932025-01-09T01:53:59.145ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4716784496464449782 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8942025-01-09T01:53:59.282ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10261251381515469033 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8952025-01-09T01:53:59.455ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4760046479622698213 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
8962025-01-09T01:54:00.245ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8972025-01-09T01:54:00.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41987
8982025-01-09T01:54:00.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 21066 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41987 req_id = 42cd067f-2c9b-460a-9d03-2fcd37be274d response_code = 200 uri = /timesync
8992025-01-09T01:54:00.271ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 214768833, ip_addr: 12.205.28.193, stratum: 3, ref_time: 1736387639.1689172, correction: -0.0485489 } file = sled-agent/src/rack_setup/service.rs:743
9002025-01-09T01:54:00.271ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9012025-01-09T01:54:00.301ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 573d190f-b843-4bac-93a9-39d7c33ed06c (service), filesystem_pool: Some(ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 808bb178-f8c3-48a5-811c-1b9a0998de13 (service), filesystem_pool: Some(ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: bb4806b3-02bb-4f7d-a237-507a255e6c22 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 818ff4df-a4e3-40a7-ad8a-b60340e4ed5b, kind: Service { id: bb4806b3-02bb-4f7d-a237-507a255e6c22 }, name: Name("ntp-bb4806b3-02bb-4f7d-a237-507a255e6c22"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 177])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e (service), filesystem_pool: Some(ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } } } }, OmicronZoneConfig { id: 5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1440162d-a5eb-470d-8c52-d6325ac4b2cc (service), filesystem_pool: Some(ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External } } } }, OmicronZoneConfig { id: dbd89a2d-f31e-4e6b-947d-9af3c2a95a36 (service), filesystem_pool: Some(ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 307503c0-c7a7-45d8-b16b-85b70ab6f38d (service), filesystem_pool: Some(ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9022025-01-09T01:54:00.301ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60529
9032025-01-09T01:54:00.302ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9042025-01-09T01:54:00.302ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, responder: ... }
9052025-01-09T01:54:00.312ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9062025-01-09T01:54:00.313ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9072025-01-09T01:54:00.322ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9082025-01-09T01:54:00.322ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9092025-01-09T01:54:00.331ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9102025-01-09T01:54:00.331ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Cockroach }, responder: ... }
9112025-01-09T01:54:00.340ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9122025-01-09T01:54:00.340ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9132025-01-09T01:54:00.349ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9142025-01-09T01:54:00.349ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9152025-01-09T01:54:00.359ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9162025-01-09T01:54:00.359ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9172025-01-09T01:54:00.369ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9182025-01-09T01:54:00.369ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9192025-01-09T01:54:00.377ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9202025-01-09T01:54:00.377ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:177
9212025-01-09T01:54:00.378ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:177
9222025-01-09T01:54:00.378ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9232025-01-09T01:54:00.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9242025-01-09T01:54:00.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9252025-01-09T01:54:00.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9262025-01-09T01:54:00.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9272025-01-09T01:54:00.463ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9282025-01-09T01:54:00.549ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc file = illumos-utils/src/zone.rs:325
9292025-01-09T01:54:00.553ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36 file = illumos-utils/src/zone.rs:325
9302025-01-09T01:54:00.557ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e file = illumos-utils/src/zone.rs:325
9312025-01-09T01:54:00.562ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d file = illumos-utils/src/zone.rs:325
9322025-01-09T01:54:00.566ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78 file = illumos-utils/src/zone.rs:325
9332025-01-09T01:54:00.571ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc file = illumos-utils/src/zone.rs:363
9342025-01-09T01:54:00.575ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36 file = illumos-utils/src/zone.rs:363
9352025-01-09T01:54:00.581ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e file = illumos-utils/src/zone.rs:363
9362025-01-09T01:54:00.585ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d file = illumos-utils/src/zone.rs:363
9372025-01-09T01:54:00.590ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78 file = illumos-utils/src/zone.rs:363
9382025-01-09T01:54:02.411ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 339.023863ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
9392025-01-09T01:54:03.556ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='307503c0-c7a7-45d8-b16b-85b70ab6f38d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9402025-01-09T01:54:03.557ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9412025-01-09T01:54:03.563ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='1440162d-a5eb-470d-8c52-d6325ac4b2cc'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9422025-01-09T01:54:03.563ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9432025-01-09T01:54:03.591ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38702
9442025-01-09T01:54:03.591ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38702 req_id = 4a0347f2-8140-4c7e-be27-d7d18c4e2968 response_code = 200 uri = /baseboard
9452025-01-09T01:54:03.628ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9462025-01-09T01:54:03.629ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9472025-01-09T01:54:03.655ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9482025-01-09T01:54:03.655ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9492025-01-09T01:54:03.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 64.480487ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9502025-01-09T01:54:03.712ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 58.884324ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9512025-01-09T01:54:03.713ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='dbd89a2d-f31e-4e6b-947d-9af3c2a95a36'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9522025-01-09T01:54:03.713ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9532025-01-09T01:54:03.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 45.606517ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9542025-01-09T01:54:03.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 111.807791ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9552025-01-09T01:54:03.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 86.453139ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9562025-01-09T01:54:04.412ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 37.363267ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9572025-01-09T01:54:04.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 56.920349ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9582025-01-09T01:54:04.680ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 133.4235ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9592025-01-09T01:54:04.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 36.210595ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9602025-01-09T01:54:04.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 81.654679ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9612025-01-09T01:54:04.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 147.082659ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9622025-01-09T01:54:04.831ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 113.504911ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9632025-01-09T01:54:04.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 288.501827ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9642025-01-09T01:54:04.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 116.244092ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9652025-01-09T01:54:04.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 213.512287ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9662025-01-09T01:54:05.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 545.576759ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9672025-01-09T01:54:05.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 333.4646ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9682025-01-09T01:54:05.153ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 122.475664ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9692025-01-09T01:54:05.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 850.770641ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9702025-01-09T01:54:05.187ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 566.411463ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9712025-01-09T01:54:05.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 285.983757ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9722025-01-09T01:54:05.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 714.397116ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9732025-01-09T01:54:05.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 1.093532699s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9742025-01-09T01:54:05.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 1.055837743s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9752025-01-09T01:54:05.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 666.500369ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9762025-01-09T01:54:06.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 900.637451ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9772025-01-09T01:54:06.148ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 550.512951ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9782025-01-09T01:54:06.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 685.628976ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9792025-01-09T01:54:06.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 681.395477ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9802025-01-09T01:54:06.683ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 912.552412ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9812025-01-09T01:54:06.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 689.785059ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9822025-01-09T01:54:06.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 915.177818ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9832025-01-09T01:54:07.132ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 666.322163ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9842025-01-09T01:54:07.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 1.105357648s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9852025-01-09T01:54:07.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 1.465531435s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9862025-01-09T01:54:07.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 1.240318932s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9872025-01-09T01:54:07.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 969.67501ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9882025-01-09T01:54:07.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 1.101505523s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9892025-01-09T01:54:08.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 1.058226359s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9902025-01-09T01:54:08.782ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 1.222378963s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9912025-01-09T01:54:08.852ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 669.260445ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9922025-01-09T01:54:08.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 673.312718ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9932025-01-09T01:54:08.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 1.422993907s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
9942025-01-09T01:54:09.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 1.195013493s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
9952025-01-09T01:54:09.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 661.833495ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9962025-01-09T01:54:09.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 1.495782127s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
9972025-01-09T01:54:10.010ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 1.002986169s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
9982025-01-09T01:54:10.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 895.508779ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
9992025-01-09T01:54:10.405ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 560.38231ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
10002025-01-09T01:54:10.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 575.492993ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
10012025-01-09T01:54:10.971ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 674.579589ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
10022025-01-09T01:54:11.019ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 731.590829ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
10032025-01-09T01:54:11.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 1.126657567s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
10042025-01-09T01:54:11.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 1.065155227s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
10052025-01-09T01:54:11.316ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d") failed: Property not found. retry in 1.28360316s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
10062025-01-09T01:54:11.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc") failed: Property not found. retry in 1.257664043s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
10072025-01-09T01:54:11.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 718.596923ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
10082025-01-09T01:54:12.186ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36") failed: Property not found. retry in 928.461161ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
10092025-01-09T01:54:12.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78") failed: Property not found. retry in 1.237014398s file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
10102025-01-09T01:54:12.487ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e") failed: Property not found. retry in 701.677542ms file = illumos-utils/src/svc.rs:36 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
10112025-01-09T01:54:13.456ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc
10122025-01-09T01:54:13.456ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_dbd89a2d-f31e-4e6b-947d-9af3c2a95a36
10132025-01-09T01:54:13.456ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e
10142025-01-09T01:54:13.456ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_307503c0-c7a7-45d8-b16b-85b70ab6f38d
10152025-01-09T01:54:13.456ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_cockroachdb_5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78
10162025-01-09T01:54:13.456ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10172025-01-09T01:54:13.457ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10182025-01-09T01:54:13.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13191946 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:60529 req_id = e1712cbe-ed9d-4ea1-a04d-5e876989517a response_code = 204 uri = /omicron-zones
10192025-01-09T01:54:13.491ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57052
10202025-01-09T01:54:13.519ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 27987 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57052 req_id = 85b77404-698e-4fd8-a542-586a08b0d405 response_code = 500 uri = /cockroachdb
10212025-01-09T01:54:13.519ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "85b77404-698e-4fd8-a542-586a08b0d405", "content-length": "124", "date": "Thu, 09 Jan 2025 01:54:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "85b77404-698e-4fd8-a542-586a08b0d405" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 124.172072ms
10222025-01-09T01:54:13.673ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService5/omicron6 in oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_1440162d-a5eb-470d-8c52-d6325ac4b2cc /usr/sbin/ipadm show-addr -p -o ADDR oxControlService5/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 28331 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57052 req_id = 3563ac66-74a2-41d9-bec3-a73f9a887497 response_code = 500 uri = /cockroachdb
10232025-01-09T01:54:13.673ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3563ac66-74a2-41d9-bec3-a73f9a887497", "content-length": "124", "date": "Thu, 09 Jan 2025 01:54:13 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3563ac66-74a2-41d9-bec3-a73f9a887497" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 120.261514ms
10242025-01-09T01:54:13.824ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::5]:32221 file = sled-agent/src/services.rs:3769
10252025-01-09T01:54:35.757ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3787
10262025-01-09T01:54:49.765ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3810
10272025-01-09T01:54:49.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35985509 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:57052 req_id = bba7526f-cf41-4813-a62c-ca3d61f392e9 response_code = 204 uri = /cockroachdb
10282025-01-09T01:54:49.773ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35925
10292025-01-09T01:54:49.785ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 461.675009ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
10302025-01-09T01:54:49.824ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 573d190f-b843-4bac-93a9-39d7c33ed06c (service), filesystem_pool: Some(ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: 3444432e-5cf4-4d19-bf8d-3e34ec2f9cb5 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 808bb178-f8c3-48a5-811c-1b9a0998de13 (service), filesystem_pool: Some(ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: bb4806b3-02bb-4f7d-a237-507a255e6c22 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 818ff4df-a4e3-40a7-ad8a-b60340e4ed5b, kind: Service { id: bb4806b3-02bb-4f7d-a237-507a255e6c22 }, name: Name("ntp-bb4806b3-02bb-4f7d-a237-507a255e6c22"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 209, 177])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 60e3bcdd-f8d3-4f85-b504-4eb9f89ab78e (service), filesystem_pool: Some(ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } } } }, OmicronZoneConfig { id: 5bc902cd-9c4e-4ca1-841b-ed93d5cb8c78 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1440162d-a5eb-470d-8c52-d6325ac4b2cc (service), filesystem_pool: Some(ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External } } } }, OmicronZoneConfig { id: dbd89a2d-f31e-4e6b-947d-9af3c2a95a36 (service), filesystem_pool: Some(ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 307503c0-c7a7-45d8-b16b-85b70ab6f38d (service), filesystem_pool: Some(ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External } } } }, OmicronZoneConfig { id: f3416805-f40d-4d68-a19c-04a4a2965ebd (service), filesystem_pool: Some(ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: f0f2e5cd-2795-4686-a722-eff994bc2526 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b (service), filesystem_pool: Some(ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 (service), filesystem_pool: Some(ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 2e61db93-7661-4d70-aa81-b31509361e0d (service), filesystem_pool: Some(ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: f358b903-2762-42d7-a571-7a0e272fbe80 (service), filesystem_pool: Some(ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } } } }, OmicronZoneConfig { id: 2177c207-1218-453e-8ff9-f97b0f5f8a68 (service), filesystem_pool: Some(ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: d4bb7079-19ee-4aef-9377-4e5d03c44e05 (service), filesystem_pool: Some(ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 090aaea6-0241-4cdf-84bd-02fd230df1d4 (service), filesystem_pool: Some(ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: cafdc5a9-a166-4ae9-8f5f-b650b8472b4c (service), filesystem_pool: Some(ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External } } } }, OmicronZoneConfig { id: 72772c45-7e28-4e5b-81fd-1edd684d4412 (service), filesystem_pool: Some(ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External } } } }, OmicronZoneConfig { id: da651304-019a-4cb3-8ffc-fa44a24482f6 (service), filesystem_pool: Some(ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External } } } }, OmicronZoneConfig { id: 88e7c988-7e07-48fa-9883-70cc4d3efeea (service), filesystem_pool: Some(ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0d9e65cf-7fba-4660-97cf-ec17195c0c8d (service), filesystem_pool: Some(ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2ce58e3d-01be-46cc-852b-0137abb8c66c (service), filesystem_pool: Some(ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External } } } }, OmicronZoneConfig { id: cf5066b4-554b-4b47-9f15-be405fc5a7da (service), filesystem_pool: Some(ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External } } } }, OmicronZoneConfig { id: 76c9801b-95c1-4cde-849a-93cf3d123677 (service), filesystem_pool: Some(ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8 (service), filesystem_pool: Some(ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10312025-01-09T01:54:49.825ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53534
10322025-01-09T01:54:49.827ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10332025-01-09T01:54:49.827ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: InternalDns }, responder: ... }
10342025-01-09T01:54:49.843ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10352025-01-09T01:54:49.843ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10362025-01-09T01:54:49.856ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10372025-01-09T01:54:49.856ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10382025-01-09T01:54:49.866ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10392025-01-09T01:54:49.866ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Cockroach }, responder: ... }
10402025-01-09T01:54:49.876ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10412025-01-09T01:54:49.876ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10422025-01-09T01:54:49.885ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10432025-01-09T01:54:49.885ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10442025-01-09T01:54:49.895ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10452025-01-09T01:54:49.895ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10462025-01-09T01:54:49.904ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10472025-01-09T01:54:49.904ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10482025-01-09T01:54:49.913ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10492025-01-09T01:54:49.913ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10502025-01-09T01:54:49.924ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10512025-01-09T01:54:49.924ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
10522025-01-09T01:54:49.934ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
10532025-01-09T01:54:49.934ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Clickhouse }, responder: ... }
10542025-01-09T01:54:49.944ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10552025-01-09T01:54:49.944ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, kind: Crucible }, responder: ... }
10562025-01-09T01:54:49.956ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10572025-01-09T01:54:49.956ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, kind: Crucible }, responder: ... }
10582025-01-09T01:54:49.975ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10592025-01-09T01:54:49.975ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, kind: Crucible }, responder: ... }
10602025-01-09T01:54:49.987ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10612025-01-09T01:54:49.987ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, kind: Crucible }, responder: ... }
10622025-01-09T01:54:49.997ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10632025-01-09T01:54:49.998ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, kind: Crucible }, responder: ... }
10642025-01-09T01:54:50.015ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10652025-01-09T01:54:50.015ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, kind: Crucible }, responder: ... }
10662025-01-09T01:54:50.034ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10672025-01-09T01:54:50.034ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, kind: Crucible }, responder: ... }
10682025-01-09T01:54:50.047ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10692025-01-09T01:54:50.047ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, kind: Crucible }, responder: ... }
10702025-01-09T01:54:50.062ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
10712025-01-09T01:54:50.062ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, kind: Crucible }, responder: ... }
10722025-01-09T01:54:50.077ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10732025-01-09T01:54:50.077ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:177
10742025-01-09T01:54:50.077ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:177
10752025-01-09T01:54:50.078ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10762025-01-09T01:54:50.240ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10772025-01-09T01:54:50.241ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10782025-01-09T01:54:50.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10792025-01-09T01:54:50.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10802025-01-09T01:54:50.244ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10812025-01-09T01:54:50.253ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10822025-01-09T01:54:50.255ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10832025-01-09T01:54:50.294ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10842025-01-09T01:54:50.294ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10852025-01-09T01:54:50.294ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10862025-01-09T01:54:50.442ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10872025-01-09T01:54:50.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10882025-01-09T01:54:50.442ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10892025-01-09T01:54:50.455ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
10902025-01-09T01:54:50.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10912025-01-09T01:54:50.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10922025-01-09T01:54:50.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10932025-01-09T01:54:50.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10942025-01-09T01:54:50.495ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10952025-01-09T01:54:50.496ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80 file = illumos-utils/src/zone.rs:325
10962025-01-09T01:54:50.501ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d file = illumos-utils/src/zone.rs:325
10972025-01-09T01:54:50.507ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05 file = illumos-utils/src/zone.rs:325
10982025-01-09T01:54:50.512ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8 file = illumos-utils/src/zone.rs:325
10992025-01-09T01:54:50.519ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea file = illumos-utils/src/zone.rs:325
11002025-01-09T01:54:50.525ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6 file = illumos-utils/src/zone.rs:325
11012025-01-09T01:54:50.530ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4 file = illumos-utils/src/zone.rs:325
11022025-01-09T01:54:50.675ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80 file = illumos-utils/src/zone.rs:363
11032025-01-09T01:54:50.680ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d file = illumos-utils/src/zone.rs:363
11042025-01-09T01:54:50.686ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05 file = illumos-utils/src/zone.rs:363
11052025-01-09T01:54:50.690ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8 file = illumos-utils/src/zone.rs:363
11062025-01-09T01:54:50.695ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea file = illumos-utils/src/zone.rs:363
11072025-01-09T01:54:50.700ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6 file = illumos-utils/src/zone.rs:363
11082025-01-09T01:54:50.705ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4 file = illumos-utils/src/zone.rs:363
11092025-01-09T01:54:50.711ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677 file = illumos-utils/src/zone.rs:325
11102025-01-09T01:54:50.718ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da file = illumos-utils/src/zone.rs:325
11112025-01-09T01:54:50.724ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c file = illumos-utils/src/zone.rs:325
11122025-01-09T01:54:50.730ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412 file = illumos-utils/src/zone.rs:325
11132025-01-09T01:54:50.736ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d file = illumos-utils/src/zone.rs:325
11142025-01-09T01:54:50.743ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68 file = illumos-utils/src/zone.rs:325
11152025-01-09T01:54:50.749ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c file = illumos-utils/src/zone.rs:325
11162025-01-09T01:54:50.819ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11172025-01-09T01:54:50.822ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677 file = illumos-utils/src/zone.rs:363
11182025-01-09T01:54:50.846ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da file = illumos-utils/src/zone.rs:363
11192025-01-09T01:54:50.860ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c file = illumos-utils/src/zone.rs:363
11202025-01-09T01:54:50.871ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412 file = illumos-utils/src/zone.rs:363
11212025-01-09T01:54:50.880ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d file = illumos-utils/src/zone.rs:363
11222025-01-09T01:54:50.889ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68 file = illumos-utils/src/zone.rs:363
11232025-01-09T01:54:50.897ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c file = illumos-utils/src/zone.rs:363
11242025-01-09T01:54:50.957ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11252025-01-09T01:54:51.037ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11262025-01-09T01:54:51.045ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11272025-01-09T01:54:51.058ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11282025-01-09T01:54:51.208ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 163, 75]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11292025-01-09T01:54:51.210ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
11302025-01-09T01:54:51.285ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11312025-01-09T01:54:51.353ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11322025-01-09T01:54:51.355ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11332025-01-09T01:54:51.355ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11342025-01-09T01:54:51.411ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 213, 54]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11352025-01-09T01:54:51.411ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
11362025-01-09T01:54:51.418ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11372025-01-09T01:54:51.418ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11382025-01-09T01:54:51.476ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 153, 1]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11392025-01-09T01:54:51.476ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
11402025-01-09T01:54:51.479ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11412025-01-09T01:54:51.479ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11422025-01-09T01:54:51.548ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 175, 128]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
11432025-01-09T01:54:51.548ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = nexus
11442025-01-09T01:54:51.550ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11452025-01-09T01:54:51.550ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11462025-01-09T01:54:51.609ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 147, 207]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11472025-01-09T01:54:51.609ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1275 zone_type = external_dns
11482025-01-09T01:54:51.612ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
11492025-01-09T01:54:51.612ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
11502025-01-09T01:54:51.624ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
11512025-01-09T01:54:51.626ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
11522025-01-09T01:54:51.626ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
11532025-01-09T01:54:51.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11542025-01-09T01:54:51.626ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
11552025-01-09T01:54:51.626ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
11562025-01-09T01:54:51.626ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
11572025-01-09T01:54:51.626ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
11582025-01-09T01:54:51.626ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
11592025-01-09T01:54:51.627ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
11602025-01-09T01:54:51.670ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
11612025-01-09T01:54:51.673ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
11622025-01-09T01:54:51.676ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11632025-01-09T01:54:51.676ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11642025-01-09T01:54:51.676ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
11652025-01-09T01:54:51.679ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
11662025-01-09T01:54:51.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11672025-01-09T01:54:51.683ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11682025-01-09T01:54:51.849ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b file = illumos-utils/src/zone.rs:325
11692025-01-09T01:54:51.859ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd file = illumos-utils/src/zone.rs:325
11702025-01-09T01:54:51.872ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33 file = illumos-utils/src/zone.rs:325
11712025-01-09T01:54:51.881ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349 file = illumos-utils/src/zone.rs:325
11722025-01-09T01:54:51.893ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526 file = illumos-utils/src/zone.rs:325
11732025-01-09T01:54:51.905ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b file = illumos-utils/src/zone.rs:363
11742025-01-09T01:54:51.917ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd file = illumos-utils/src/zone.rs:363
11752025-01-09T01:54:51.931ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33 file = illumos-utils/src/zone.rs:363
11762025-01-09T01:54:51.942ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349 file = illumos-utils/src/zone.rs:363
11772025-01-09T01:54:51.951ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526 file = illumos-utils/src/zone.rs:363
11782025-01-09T01:55:08.253ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.278919733s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
11792025-01-09T01:55:09.004ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11802025-01-09T01:55:09.005ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11812025-01-09T01:55:09.005ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11822025-01-09T01:55:09.006ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
11832025-01-09T01:55:09.018ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
11842025-01-09T01:55:09.023ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
11852025-01-09T01:55:09.052ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='37599d1d-457a-4715-8183-bcc93c14684e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11862025-01-09T01:55:09.053ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ef1e6b73-6793-466e-a799-e2f9bf924583'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11872025-01-09T01:55:09.053ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8c36afa3-634a-45ef-8e74-4050d7fb5a2f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11882025-01-09T01:55:09.053ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_e3b35f00-104f-4cfc-b343-844e77de82c6/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='62796786-220f-4dcc-ab6e-8aad6ef9768b'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11892025-01-09T01:55:09.053ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4044a6e6-7654-4599-82ea-b31417f53ccb'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11902025-01-09T01:55:09.053ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_6f3f94ab-1776-457a-b887-7085a2c11828/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='8a038cb5-46a1-4514-b7de-b4078e46bc42'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11912025-01-09T01:55:09.053ZINFOSledAgent (ServiceManager): Booting oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
11922025-01-09T01:55:09.061ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
11932025-01-09T01:55:09.066ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ad2a67e2-f422-44b1-9369-967ebd803b36'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11942025-01-09T01:55:09.066ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
11952025-01-09T01:55:09.072ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
11962025-01-09T01:55:09.078ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
11972025-01-09T01:55:09.083ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b3170a31-a930-4451-8931-26ea4c86dd47'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
11982025-01-09T01:55:09.083ZINFOSledAgent (ServiceManager): Booting oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
11992025-01-09T01:55:09.089ZINFOSledAgent (ServiceManager): Booting oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
12002025-01-09T01:55:09.095ZINFOSledAgent (ServiceManager): Booting oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
12012025-01-09T01:55:09.194ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12022025-01-09T01:55:09.195ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
12032025-01-09T01:55:09.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 60.646363ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
12042025-01-09T01:55:09.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 44.572891ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
12052025-01-09T01:55:09.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 69.614829ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
12062025-01-09T01:55:09.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 57.893991ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
12072025-01-09T01:55:09.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 57.768392ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
12082025-01-09T01:55:09.500ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 40.685403ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
12092025-01-09T01:55:09.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 66.260574ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
12102025-01-09T01:55:09.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 51.157426ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
12112025-01-09T01:55:09.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 46.092238ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
12122025-01-09T01:55:09.718ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 95.721504ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
12132025-01-09T01:55:09.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 122.781254ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
12142025-01-09T01:55:09.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 116.67433ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
12152025-01-09T01:55:09.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 102.172948ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
12162025-01-09T01:55:09.855ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 79.449989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
12172025-01-09T01:55:09.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 108.494741ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
12182025-01-09T01:55:09.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 52.086015ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
12192025-01-09T01:55:09.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 111.203742ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
12202025-01-09T01:55:09.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 61.29917ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
12212025-01-09T01:55:09.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 81.634556ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
12222025-01-09T01:55:09.930ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='2e61db93-7661-4d70-aa81-b31509361e0d'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12232025-01-09T01:55:09.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 52.048512ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
12242025-01-09T01:55:09.963ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 38.92855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
12252025-01-09T01:55:09.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 232.390448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
12262025-01-09T01:55:09.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 272.046669ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
12272025-01-09T01:55:10.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 134.10467ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
12282025-01-09T01:55:10.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 285.839656ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
12292025-01-09T01:55:10.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 296.474423ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
12302025-01-09T01:55:10.060ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 171.034576ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
12312025-01-09T01:55:10.076ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 197.34841ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
12322025-01-09T01:55:10.091ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 109.527082ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
12332025-01-09T01:55:10.107ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 105.441419ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
12342025-01-09T01:55:10.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 296.155723ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
12352025-01-09T01:55:10.121ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
12362025-01-09T01:55:10.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 105.766899ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
12372025-01-09T01:55:10.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 52.765864ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
12382025-01-09T01:55:10.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 235.366505ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
12392025-01-09T01:55:10.216ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 559.988827ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
12402025-01-09T01:55:10.231ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 486.333073ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
12412025-01-09T01:55:10.243ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 218.179601ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
12422025-01-09T01:55:10.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 143.471034ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
12432025-01-09T01:55:10.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 285.670171ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
12442025-01-09T01:55:10.275ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 156.337289ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
12452025-01-09T01:55:10.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 385.357331ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
12462025-01-09T01:55:10.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 357.00851ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
12472025-01-09T01:55:10.322ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 367.821213ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
12482025-01-09T01:55:10.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 399.735884ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
12492025-01-09T01:55:10.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 70.147978ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
12502025-01-09T01:55:10.413ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 378.085301ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
12512025-01-09T01:55:10.425ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 515.641218ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
12522025-01-09T01:55:10.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 431.626419ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
12532025-01-09T01:55:10.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 301.324406ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
12542025-01-09T01:55:10.471ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 569.534891ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
12552025-01-09T01:55:10.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 85.435984ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
12562025-01-09T01:55:10.562ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 420.204127ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
12572025-01-09T01:55:10.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 187.592725ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
12582025-01-09T01:55:10.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 549.172413ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
12592025-01-09T01:55:10.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 1.174246333s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
12602025-01-09T01:55:10.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 763.185905ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
12612025-01-09T01:55:10.729ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 490.079786ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
12622025-01-09T01:55:10.764ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 1.092616676s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
12632025-01-09T01:55:10.776ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 1.000550721s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
12642025-01-09T01:55:10.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 507.94794ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
12652025-01-09T01:55:10.801ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 783.304577ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
12662025-01-09T01:55:10.812ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 630.49064ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
12672025-01-09T01:55:10.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 728.057202ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
12682025-01-09T01:55:10.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 721.892224ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
12692025-01-09T01:55:10.995ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 559.686172ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
12702025-01-09T01:55:11.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 629.535353ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
12712025-01-09T01:55:11.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 632.01184ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
12722025-01-09T01:55:11.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 1.392071104s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
12732025-01-09T01:55:11.588ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 659.367855ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
12742025-01-09T01:55:11.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 1.02571331s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
12752025-01-09T01:55:11.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 544.699294ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
12762025-01-09T01:55:11.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 746.537131ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
12772025-01-09T01:55:11.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 1.07571729s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
12782025-01-09T01:55:11.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 559.157614ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
12792025-01-09T01:55:11.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 1.450532887s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
12802025-01-09T01:55:11.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 896.398348ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
12812025-01-09T01:55:11.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 779.440879ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
12822025-01-09T01:55:11.905ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 1.414469042s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
12832025-01-09T01:55:11.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 1.486129743s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
12842025-01-09T01:55:11.922ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12852025-01-09T01:55:11.922ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12862025-01-09T01:55:11.923ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12872025-01-09T01:55:11.923ZINFOSledAgent (ServiceManager): Booting oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
12882025-01-09T01:55:11.930ZINFOSledAgent (ServiceManager): Booting oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
12892025-01-09T01:55:11.938ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
12902025-01-09T01:55:12.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 1.396568988s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
12912025-01-09T01:55:12.158ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 40.053381ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
12922025-01-09T01:55:12.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 61.090605ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
12932025-01-09T01:55:12.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 43.096888ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
12942025-01-09T01:55:12.209ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 88.636332ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
12952025-01-09T01:55:12.246ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 133.551281ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
12962025-01-09T01:55:12.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 103.309994ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
12972025-01-09T01:55:12.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 837.246956ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
12982025-01-09T01:55:12.280ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 609.068246ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
12992025-01-09T01:55:12.307ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 249.550025ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
13002025-01-09T01:55:12.309ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13012025-01-09T01:55:12.310ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13022025-01-09T01:55:12.316ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2414008d-221a-4a74-800b-eda0a3acdf4d/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='72c72ea4-f403-445f-802a-261dcc3f2288'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13032025-01-09T01:55:12.316ZINFOSledAgent (ServiceManager): Booting oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13042025-01-09T01:55:12.374ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 211.807279ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
13052025-01-09T01:55:12.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 1.350659129s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
13062025-01-09T01:55:12.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 227.557646ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
13072025-01-09T01:55:12.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 1.120229066s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
13082025-01-09T01:55:12.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 61.057803ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13092025-01-09T01:55:12.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 66.304056ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13102025-01-09T01:55:12.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 459.194251ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
13112025-01-09T01:55:12.596ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 213.300751ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
13122025-01-09T01:55:12.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 138.422659ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13132025-01-09T01:55:12.645ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 84.155523ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13142025-01-09T01:55:12.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 261.798829ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
13152025-01-09T01:55:12.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 634.840448ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
13162025-01-09T01:55:12.746ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 646.572711ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
13172025-01-09T01:55:12.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 184.234276ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13182025-01-09T01:55:12.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 108.644821ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13192025-01-09T01:55:12.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 1.294596881s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
13202025-01-09T01:55:12.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 873.088486ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
13212025-01-09T01:55:12.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 1.30240988s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
13222025-01-09T01:55:12.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 1.220177715s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
13232025-01-09T01:55:12.918ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 592.471128ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13242025-01-09T01:55:12.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 654.836499ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
13252025-01-09T01:55:12.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 497.398853ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
13262025-01-09T01:55:12.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 287.062756ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13272025-01-09T01:55:13.042ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 745.824233ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
13282025-01-09T01:55:13.119ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 507.003145ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
13292025-01-09T01:55:13.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 657.743304ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13302025-01-09T01:55:13.324ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 819.960706ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
13312025-01-09T01:55:13.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 1.164356761s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
13322025-01-09T01:55:13.372ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 1.216784153s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
13332025-01-09T01:55:13.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 1.291526908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
13342025-01-09T01:55:13.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 1.372755365s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
13352025-01-09T01:55:13.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 1.14559133s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
13362025-01-09T01:55:13.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 1.446524619s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
13372025-01-09T01:55:13.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 704.855647ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13382025-01-09T01:55:13.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 1.407014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
13392025-01-09T01:55:13.632ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 578.528826ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
13402025-01-09T01:55:13.647ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 1.253578049s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
13412025-01-09T01:55:13.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 958.209252ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
13422025-01-09T01:55:13.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 883.734651ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
13432025-01-09T01:55:13.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 714.302143ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
13442025-01-09T01:55:13.950ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 580.285424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13452025-01-09T01:55:14.115ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 1.223775013s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
13462025-01-09T01:55:14.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 750.664541ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
13472025-01-09T01:55:14.163ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 1.028101852s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
13482025-01-09T01:55:14.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 835.685777ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
13492025-01-09T01:55:14.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 1.08404569s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
13502025-01-09T01:55:14.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 819.234102ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13512025-01-09T01:55:14.519ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 1.190213191s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
13522025-01-09T01:55:14.540ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 1.213698091s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
13532025-01-09T01:55:14.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 1.097548645s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13542025-01-09T01:55:14.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 1.202414476s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
13552025-01-09T01:55:14.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 585.087ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
13562025-01-09T01:55:14.670ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 726.797067ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
13572025-01-09T01:55:14.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 1.210896794s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
13582025-01-09T01:55:14.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 1.41189574s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
13592025-01-09T01:55:14.823ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 756.983734ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
13602025-01-09T01:55:14.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 605.899256ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
13612025-01-09T01:55:14.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 1.465693554s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
13622025-01-09T01:55:15.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 1.473177374s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
13632025-01-09T01:55:15.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 1.373678717s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
13642025-01-09T01:55:15.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 648.03183ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
13652025-01-09T01:55:15.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 540.171584ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13662025-01-09T01:55:15.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 1.195991799s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
13672025-01-09T01:55:15.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 1.038648507s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
13682025-01-09T01:55:15.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 730.877281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
13692025-01-09T01:55:15.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 813.018197ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
13702025-01-09T01:55:15.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 1.43103598s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
13712025-01-09T01:55:15.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 969.907143ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
13722025-01-09T01:55:15.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 1.029135589s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
13732025-01-09T01:55:15.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 523.085059ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13742025-01-09T01:55:15.694ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 1.0416168s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13752025-01-09T01:55:15.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 834.943471ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
13762025-01-09T01:55:15.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 676.458408ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
13772025-01-09T01:55:15.767ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 1.446865747s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
13782025-01-09T01:55:15.842ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 519.721492ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
13792025-01-09T01:55:15.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 696.41537ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
13802025-01-09T01:55:16.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 656.112981ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
13812025-01-09T01:55:16.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 708.195146ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
13822025-01-09T01:55:16.185ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 1.457778063s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
13832025-01-09T01:55:16.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 1.293613543s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
13842025-01-09T01:55:16.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 1.466596288s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
13852025-01-09T01:55:16.378ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 1.305049714s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
13862025-01-09T01:55:16.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 882.195235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
13872025-01-09T01:55:16.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 1.077466904s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
13882025-01-09T01:55:16.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 606.407676ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
13892025-01-09T01:55:16.442ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 1.0750058s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
13902025-01-09T01:55:16.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 1.390267508s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
13912025-01-09T01:55:16.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 833.487482ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
13922025-01-09T01:55:16.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 1.345000045s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
13932025-01-09T01:55:16.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 1.243597084s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
13942025-01-09T01:55:16.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 1.025155678s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
13952025-01-09T01:55:16.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 1.427672332s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
13962025-01-09T01:55:16.760ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 1.371307012s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
13972025-01-09T01:55:16.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 987.525185ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
13982025-01-09T01:55:16.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 1.356529668s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
13992025-01-09T01:55:17.053ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 1.236297143s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
14002025-01-09T01:55:17.228ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 1.174127949s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
14012025-01-09T01:55:17.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 1.247702732s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
14022025-01-09T01:55:17.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 813.585182ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
14032025-01-09T01:55:17.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 1.465000469s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
14042025-01-09T01:55:17.527ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 668.49364ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
14052025-01-09T01:55:17.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 1.355257985s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
14062025-01-09T01:55:17.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 822.230489ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
14072025-01-09T01:55:17.674ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 1.185042655s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
14082025-01-09T01:55:17.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 882.648089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
14092025-01-09T01:55:17.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 542.938723ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
14102025-01-09T01:55:17.861ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 712.235048ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
14112025-01-09T01:55:17.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 544.905947ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
14122025-01-09T01:55:17.894ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 1.156175373s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
14132025-01-09T01:55:17.914ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 932.012317ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
14142025-01-09T01:55:18.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 853.624485ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
14152025-01-09T01:55:18.200ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 1.292717496s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
14162025-01-09T01:55:18.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 831.572764ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
14172025-01-09T01:55:18.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 981.522077ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
14182025-01-09T01:55:18.266ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 849.487858ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
14192025-01-09T01:55:18.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 616.96226ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
14202025-01-09T01:55:18.353ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 725.778856ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
14212025-01-09T01:55:18.420ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 620.747044ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
14222025-01-09T01:55:18.450ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 1.499049036s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
14232025-01-09T01:55:18.499ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 1.423039792s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
14242025-01-09T01:55:18.568ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 665.69498ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
14252025-01-09T01:55:18.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 1.195296561s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
14262025-01-09T01:55:18.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 1.183274415s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
14272025-01-09T01:55:18.795ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14282025-01-09T01:55:18.795ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
14292025-01-09T01:55:18.859ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 1.096436352s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
14302025-01-09T01:55:18.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 860.854559ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
14312025-01-09T01:55:18.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 636.706941ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
14322025-01-09T01:55:18.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 705.556259ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
14332025-01-09T01:55:19.050ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39567
14342025-01-09T01:55:19.212ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 738.171989ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
14352025-01-09T01:55:19.285ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79746 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39567 req_id = 293fd0b7-2a0e-4581-b193-49c2d6f90b69 response_code = 200 uri = /baseboard
14362025-01-09T01:55:19.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 748.683069ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
14372025-01-09T01:55:19.349ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 1.160197572s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
14382025-01-09T01:55:19.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 1.369733925s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
14392025-01-09T01:55:19.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 882.69483ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
14402025-01-09T01:55:19.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 524.647169ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
14412025-01-09T01:55:19.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 566.115369ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
14422025-01-09T01:55:19.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 1.417412446s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
14432025-01-09T01:55:19.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 48.013061ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
14442025-01-09T01:55:19.406ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 1.498284602s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
14452025-01-09T01:55:19.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 78.032932ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
14462025-01-09T01:55:19.501ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 1.067504304s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
14472025-01-09T01:55:19.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 254.03981ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
14482025-01-09T01:55:19.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 743.280089ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
14492025-01-09T01:55:19.658ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 1.112091487s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
14502025-01-09T01:55:19.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 768.134955ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
14512025-01-09T01:55:19.791ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 717.240092ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
14522025-01-09T01:55:19.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 827.309455ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
14532025-01-09T01:55:19.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 358.83303ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
14542025-01-09T01:55:19.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 1.129507017s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
14552025-01-09T01:55:19.932ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 960.607963ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
14562025-01-09T01:55:19.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 776.831843ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
14572025-01-09T01:55:19.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 859.754694ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
14582025-01-09T01:55:19.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 1.042708406s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
14592025-01-09T01:55:19.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 992.260294ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
14602025-01-09T01:55:20.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 1.369781654s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
14612025-01-09T01:55:20.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 733.387151ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
14622025-01-09T01:55:20.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 548.608746ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
14632025-01-09T01:55:20.309ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 856.492235ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
14642025-01-09T01:55:20.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 995.934054ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
14652025-01-09T01:55:20.526ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 1.058864361s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
14662025-01-09T01:55:20.534ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 1.039153014s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
14672025-01-09T01:55:20.578ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 1.315721174s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
14682025-01-09T01:55:20.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 1.171414568s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
14692025-01-09T01:55:20.737ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 1.10607982s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
14702025-01-09T01:55:20.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 655.251008ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
14712025-01-09T01:55:20.779ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 1.456245312s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
14722025-01-09T01:55:20.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 547.593451ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
14732025-01-09T01:55:20.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 929.186578ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
14742025-01-09T01:55:20.840ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 1.325873327s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
14752025-01-09T01:55:20.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 955.711458ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
14762025-01-09T01:55:20.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 1.063464377s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
14772025-01-09T01:55:20.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 1.102182085s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
14782025-01-09T01:55:20.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 1.244018611s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
14792025-01-09T01:55:21.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 1.179415538s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
14802025-01-09T01:55:21.046ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 1.363413913s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
14812025-01-09T01:55:21.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 1.142102272s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
14822025-01-09T01:55:21.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 1.255876097s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
14832025-01-09T01:55:21.411ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 1.398663104s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
14842025-01-09T01:55:21.427ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 761.515633ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
14852025-01-09T01:55:21.523ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 826.978127ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
14862025-01-09T01:55:21.582ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 959.670177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
14872025-01-09T01:55:21.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 938.65495ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
14882025-01-09T01:55:21.763ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 604.960214ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
14892025-01-09T01:55:21.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 1.185380597s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
14902025-01-09T01:55:21.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 658.611158ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
14912025-01-09T01:55:21.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 873.929484ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
14922025-01-09T01:55:21.903ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 1.205258703s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
14932025-01-09T01:55:21.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 1.361755587s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
14942025-01-09T01:55:22.038ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 899.07862ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
14952025-01-09T01:55:22.175ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 767.017278ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
14962025-01-09T01:55:22.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 1.31036953s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
14972025-01-09T01:55:22.213ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 1.260742693s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
14982025-01-09T01:55:22.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 724.175677ms file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
14992025-01-09T01:55:22.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 771.0351ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
15002025-01-09T01:55:22.326ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 626.64679ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
15012025-01-09T01:55:22.360ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 582.704814ms file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
15022025-01-09T01:55:22.377ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 1.075273925s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
15032025-01-09T01:55:22.421ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da") failed: Property not found. retry in 1.396059367s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
15042025-01-09T01:55:22.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 678.057029ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
15052025-01-09T01:55:22.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 505.663424ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
15062025-01-09T01:55:22.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05") failed: Property not found. retry in 1.400874905s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
15072025-01-09T01:55:22.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 525.482967ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
15082025-01-09T01:55:22.755ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6") failed: Property not found. retry in 694.374071ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
15092025-01-09T01:55:22.819ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349") failed: Property not found. retry in 881.943921ms file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
15102025-01-09T01:55:22.948ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 630.094407ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
15112025-01-09T01:55:22.957ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd") failed: Property not found. retry in 1.240444778s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
15122025-01-09T01:55:22.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526") failed: Property not found. retry in 1.4142514s file = illumos-utils/src/svc.rs:36 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
15132025-01-09T01:55:22.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677") failed: Property not found. retry in 839.054281ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
15142025-01-09T01:55:22.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d") failed: Property not found. retry in 1.080154031s file = illumos-utils/src/svc.rs:36 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
15152025-01-09T01:55:23.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4") failed: Property not found. retry in 1.354361919s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
15162025-01-09T01:55:23.024ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68") failed: Property not found. retry in 875.799177ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
15172025-01-09T01:55:23.056ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c") failed: Property not found. retry in 791.313815ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
15182025-01-09T01:55:23.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412") failed: Property not found. retry in 1.053919892s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
15192025-01-09T01:55:23.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea") failed: Property not found. retry in 1.371210072s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
15202025-01-09T01:55:23.217ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33") failed: Property not found. retry in 1.386794075s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
15212025-01-09T01:55:23.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d") failed: Property not found. retry in 1.324718908s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
15222025-01-09T01:55:23.475ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c") failed: Property not found. retry in 1.297030494s file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
15232025-01-09T01:55:23.484ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8") failed: Property not found. retry in 871.403804ms file = illumos-utils/src/svc.rs:36 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
15242025-01-09T01:55:23.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b") failed: Property not found. retry in 1.474369362s file = illumos-utils/src/svc.rs:36 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
15252025-01-09T01:55:23.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 851.048909ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
15262025-01-09T01:55:24.463ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 1.098234068s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
15272025-01-09T01:55:24.944ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.741415291s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
15282025-01-09T01:55:25.589ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 544.036633ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
15292025-01-09T01:55:26.156ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 1.269044609s file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
15302025-01-09T01:55:27.443ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 570.611501ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
15312025-01-09T01:55:27.539ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 3.297684792s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
15322025-01-09T01:55:28.025ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 773.668861ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
15332025-01-09T01:55:28.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80") failed: Property not found. retry in 840.940954ms file = illumos-utils/src/svc.rs:36 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
15342025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_clickhouse_f358b903-2762-42d7-a571-7a0e272fbe80
15352025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_0d9e65cf-7fba-4660-97cf-ec17195c0c8d
15362025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_d4bb7079-19ee-4aef-9377-4e5d03c44e05
15372025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_2bce4334-523f-4dc9-9b30-b7dbf2aaa4f8
15382025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_529d4c5c-68f4-4868-89bd-83eaa1aa4e8b
15392025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_f3416805-f40d-4d68-a19c-04a4a2965ebd
15402025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_e7344e32-c3b3-43f7-8c30-e8bae4108d33
15412025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_88e7c988-7e07-48fa-9883-70cc4d3efeea
15422025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_da651304-019a-4cb3-8ffc-fa44a24482f6
15432025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_090aaea6-0241-4cdf-84bd-02fd230df1d4
15442025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_76c9801b-95c1-4cde-849a-93cf3d123677
15452025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_cf5066b4-554b-4b47-9f15-be405fc5a7da
15462025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_nexus_c0a9365d-d13c-4032-a1ed-9ff69918b349
15472025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_external_dns_f0f2e5cd-2795-4686-a722-eff994bc2526
15482025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_cafdc5a9-a166-4ae9-8f5f-b650b8472b4c
15492025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_72772c45-7e28-4e5b-81fd-1edd684d4412
15502025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_oximeter_2e61db93-7661-4d70-aa81-b31509361e0d
15512025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_pantry_2177c207-1218-453e-8ff9-f97b0f5f8a68
15522025-01-09T01:55:29.678ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3336 zone = oxz_crucible_2ce58e3d-01be-46cc-852b-0137abb8c66c
15532025-01-09T01:55:29.680ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15542025-01-09T01:55:29.682ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
15552025-01-09T01:55:29.686ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39859238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:53534 req_id = 672ca7c8-9c7b-486b-99ee-8705404e1859 response_code = 204 uri = /omicron-zones
15562025-01-09T01:55:29.698ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
15572025-01-09T01:55:29.708ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
15582025-01-09T01:55:29.712ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::a]:12221 file = sled-agent/src/rack_setup/service.rs:803
15592025-01-09T01:55:29.748ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
15602025-01-09T01:55:29.754ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/763db3d3-4c43-4ed5-8d9c-77e8932637e9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15612025-01-09T01:55:29.866ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/763db3d3-4c43-4ed5-8d9c-77e8932637e9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15622025-01-09T01:55:30.002ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/763db3d3-4c43-4ed5-8d9c-77e8932637e9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15632025-01-09T01:55:30.132ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/763db3d3-4c43-4ed5-8d9c-77e8932637e9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15642025-01-09T01:55:30.309ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/763db3d3-4c43-4ed5-8d9c-77e8932637e9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15652025-01-09T01:55:30.533ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/763db3d3-4c43-4ed5-8d9c-77e8932637e9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15662025-01-09T01:55:30.876ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/763db3d3-4c43-4ed5-8d9c-77e8932637e9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15672025-01-09T01:55:30.877ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.420499002s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
15682025-01-09T01:55:31.278ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/763db3d3-4c43-4ed5-8d9c-77e8932637e9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15692025-01-09T01:55:31.751ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::a]:12221/racks/763db3d3-4c43-4ed5-8d9c-77e8932637e9/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
15702025-01-09T01:55:33.271ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "f9fb7798-6d1d-4d78-b73b-e716225da8e7", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"763db3d3-4c43-4ed5-8d9c-77e8932637e9\"", request_id: "f9fb7798-6d1d-4d78-b73b-e716225da8e7" } file = sled-agent/src/rack_setup/service.rs:1079
15712025-01-09T01:55:33.714ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "b996926e-7577-4ddb-8bb7-2c8377785f4e", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"763db3d3-4c43-4ed5-8d9c-77e8932637e9\"", request_id: "b996926e-7577-4ddb-8bb7-2c8377785f4e" } file = sled-agent/src/rack_setup/service.rs:1079
15722025-01-09T01:55:34.644ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1609ddcb-9952-4c5e-b97e-b1706df84795", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:33 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"763db3d3-4c43-4ed5-8d9c-77e8932637e9\"", request_id: "1609ddcb-9952-4c5e-b97e-b1706df84795" } file = sled-agent/src/rack_setup/service.rs:1079
15732025-01-09T01:55:36.331ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "436596a0-03e9-4147-bd40-11118f85feb2", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:36 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6fecef6-14a9-49d3-a8bb-39ae9e1483bd\"", request_id: "436596a0-03e9-4147-bd40-11118f85feb2" } file = sled-agent/src/rack_setup/service.rs:1079
15742025-01-09T01:55:37.838ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "018847b4-29f7-4e06-b440-bd14f0c9e33c", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:37 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6fecef6-14a9-49d3-a8bb-39ae9e1483bd\"", request_id: "018847b4-29f7-4e06-b440-bd14f0c9e33c" } file = sled-agent/src/rack_setup/service.rs:1079
15752025-01-09T01:55:39.273ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e0d60217-97bb-45ba-a378-581219b03e39", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6fecef6-14a9-49d3-a8bb-39ae9e1483bd\"", request_id: "e0d60217-97bb-45ba-a378-581219b03e39" } file = sled-agent/src/rack_setup/service.rs:1079
15762025-01-09T01:55:41.282ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "e8801f7c-d47e-4708-8190-71dc5d0b50cf", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6fecef6-14a9-49d3-a8bb-39ae9e1483bd\"", request_id: "e8801f7c-d47e-4708-8190-71dc5d0b50cf" } file = sled-agent/src/rack_setup/service.rs:1079
15772025-01-09T01:55:44.114ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "0df6adf5-e2f4-40c5-97e9-0f071cd4f73e", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:44 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6fecef6-14a9-49d3-a8bb-39ae9e1483bd\"", request_id: "0df6adf5-e2f4-40c5-97e9-0f071cd4f73e" } file = sled-agent/src/rack_setup/service.rs:1079
15782025-01-09T01:55:45.650ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a51a7fd6-787b-4f45-b71b-6a8e76610bf2", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:45 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6fecef6-14a9-49d3-a8bb-39ae9e1483bd\"", request_id: "a51a7fd6-787b-4f45-b71b-6a8e76610bf2" } file = sled-agent/src/rack_setup/service.rs:1079
15792025-01-09T01:55:48.502ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "eec6e38f-95c8-4c8d-880f-f65224e462dc", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:48 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6fecef6-14a9-49d3-a8bb-39ae9e1483bd\"", request_id: "eec6e38f-95c8-4c8d-880f-f65224e462dc" } file = sled-agent/src/rack_setup/service.rs:1079
15802025-01-09T01:55:49.321ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37243
15812025-01-09T01:55:49.321ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37243 req_id = 5e2c2aac-d6c7-47c8-a411-b9bd8c92de4b response_code = 200 uri = /baseboard
15822025-01-09T01:55:51.371ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "75232950-c8f8-4b99-bb1d-835730f1d038", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:51 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6fecef6-14a9-49d3-a8bb-39ae9e1483bd\"", request_id: "75232950-c8f8-4b99-bb1d-835730f1d038" } file = sled-agent/src/rack_setup/service.rs:1079
15832025-01-09T01:55:54.216ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "1f168be3-4d43-4a46-bb2e-ee5fef4bcd8e", "content-length": "173", "date": "Thu, 09 Jan 2025 01:55:54 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"e6fecef6-14a9-49d3-a8bb-39ae9e1483bd\"", request_id: "1f168be3-4d43-4a46-bb2e-ee5fef4bcd8e" } file = sled-agent/src/rack_setup/service.rs:1079
15842025-01-09T01:55:58.224ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
15852025-01-09T01:55:58.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43552
15862025-01-09T01:55:58.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15872025-01-09T01:55:58.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
15882025-01-09T01:55:58.410ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:177
15892025-01-09T01:55:58.415ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:177
15902025-01-09T01:55:58.428ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15912025-01-09T01:55:58.428ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2414008d-221a-4a74-800b-eda0a3acdf4d
15922025-01-09T01:55:58.458ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15932025-01-09T01:55:58.458ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247
15942025-01-09T01:55:58.484ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15952025-01-09T01:55:58.484ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6f3f94ab-1776-457a-b887-7085a2c11828
15962025-01-09T01:55:58.509ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15972025-01-09T01:55:58.509ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8
15982025-01-09T01:55:58.532ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
15992025-01-09T01:55:58.532ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3b35f00-104f-4cfc-b343-844e77de82c6
16002025-01-09T01:55:58.553ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16012025-01-09T01:55:58.553ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963
16022025-01-09T01:55:58.575ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16032025-01-09T01:55:58.575ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c
16042025-01-09T01:55:58.596ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16052025-01-09T01:55:58.596ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3
16062025-01-09T01:55:58.618ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16072025-01-09T01:55:58.618ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13
16082025-01-09T01:55:58.630ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220854 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43552 req_id = 716e5a87-63f3-4fa0-a64d-695e429aad84 response_code = 200 uri = /inventory
16092025-01-09T01:55:59.952ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45995
16102025-01-09T01:55:59.955ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16112025-01-09T01:55:59.955ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16122025-01-09T01:55:59.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16132025-01-09T01:55:59.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16142025-01-09T01:55:59.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16152025-01-09T01:55:59.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16162025-01-09T01:55:59.959ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16172025-01-09T01:55:59.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45995 req_id = a8531ceb-cdfd-4180-9472-c7a35012b14b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16182025-01-09T01:55:59.960ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
16192025-01-09T01:55:59.963ZINFOSledAgent (RSS): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16202025-01-09T01:55:59.964ZINFOSledAgent (RSS): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
16212025-01-09T01:56:00.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44657
16222025-01-09T01:56:00.266ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16232025-01-09T01:56:00.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16242025-01-09T01:56:00.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16252025-01-09T01:56:00.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16262025-01-09T01:56:00.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16272025-01-09T01:56:00.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16282025-01-09T01:56:00.266ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16292025-01-09T01:56:00.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 344 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44657 req_id = 2fab1207-797c-4dba-921f-f9d44af89fb9 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16302025-01-09T01:56:00.439ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60231
16312025-01-09T01:56:00.440ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16322025-01-09T01:56:00.440ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16332025-01-09T01:56:00.440ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:177
16342025-01-09T01:56:00.441ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:177
16352025-01-09T01:56:00.452ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16362025-01-09T01:56:00.453ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2414008d-221a-4a74-800b-eda0a3acdf4d
16372025-01-09T01:56:00.476ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16382025-01-09T01:56:00.476ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247
16392025-01-09T01:56:00.498ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16402025-01-09T01:56:00.498ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6f3f94ab-1776-457a-b887-7085a2c11828
16412025-01-09T01:56:00.519ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16422025-01-09T01:56:00.519ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8
16432025-01-09T01:56:00.538ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16442025-01-09T01:56:00.538ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3b35f00-104f-4cfc-b343-844e77de82c6
16452025-01-09T01:56:00.560ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16462025-01-09T01:56:00.560ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963
16472025-01-09T01:56:00.582ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16482025-01-09T01:56:00.582ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c
16492025-01-09T01:56:00.605ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16502025-01-09T01:56:00.605ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3
16512025-01-09T01:56:00.625ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16522025-01-09T01:56:00.625ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13
16532025-01-09T01:56:00.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196659 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60231 req_id = a4dedb87-52a2-4714-9c2c-478492baac3a response_code = 200 uri = /inventory
16542025-01-09T01:56:01.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49311
16552025-01-09T01:56:01.287ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16562025-01-09T01:56:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16572025-01-09T01:56:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16582025-01-09T01:56:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16592025-01-09T01:56:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16602025-01-09T01:56:01.287ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16612025-01-09T01:56:01.288ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16622025-01-09T01:56:01.288ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 369 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:49311 req_id = 30c78eab-7826-407b-adb1-500a8528f452 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16632025-01-09T01:56:01.574ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53529
16642025-01-09T01:56:01.574ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16652025-01-09T01:56:01.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16662025-01-09T01:56:01.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16672025-01-09T01:56:01.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16682025-01-09T01:56:01.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
16692025-01-09T01:56:01.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16702025-01-09T01:56:01.574ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16712025-01-09T01:56:01.574ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 294 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53529 req_id = fffaf5c1-af91-4bdc-825d-2372668b56ad response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16722025-01-09T01:56:03.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38304
16732025-01-09T01:56:03.781ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 990 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38304 req_id = 5a2b1a6b-0fdb-4b76-af66-56974bce3fdf response_code = 200 uri = /vpc-routes
16742025-01-09T01:56:03.864ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
16752025-01-09T01:56:03.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 688 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38304 req_id = a47b2faf-82d5-4a1d-a7b3-6307109b05d9 response_code = 204 uri = /eip-gateways
16762025-01-09T01:56:03.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63017
16772025-01-09T01:56:03.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 671 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63017 req_id = c60a3d28-f7f7-4bd8-ad65-94d334e4f74d response_code = 200 uri = /vpc-routes
16782025-01-09T01:56:04.061ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
16792025-01-09T01:56:04.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63017 req_id = 84d15fd3-8e44-4725-87bb-690c66aa0d86 response_code = 204 uri = /eip-gateways
16802025-01-09T01:56:04.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40697
16812025-01-09T01:56:04.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 462 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40697 req_id = 64466f4b-a9fe-4593-9ae3-c2065c1191ce response_code = 200 uri = /v2p
16822025-01-09T01:56:04.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53926
16832025-01-09T01:56:04.218ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
16842025-01-09T01:56:04.324ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
16852025-01-09T01:56:04.401ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 183050 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53926 req_id = 8407d16e-fe78-4c27-9e9d-301f758721af response_code = 204 uri = /switch-ports
16862025-01-09T01:56:04.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44741
16872025-01-09T01:56:04.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65282
16882025-01-09T01:56:04.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
16892025-01-09T01:56:04.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53926 req_id = 795dc1e9-57e2-4aae-b94a-95636f074bbd response_code = 200 uri = /network-bootstore-config
16902025-01-09T01:56:04.413ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4570 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65282 req_id = 8788f0fd-276c-49ec-8bc3-617cba300bba response_code = 200 uri = /v2p
16912025-01-09T01:56:04.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13160 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63017 req_id = 8ae68683-ecfb-4731-854f-0a662d7ce8fe response_code = 204 uri = /vpc-routes
16922025-01-09T01:56:04.415ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
16932025-01-09T01:56:04.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 13529 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38304 req_id = f02a61d7-ddf7-4fcc-9e36-c01ea91a46d4 response_code = 204 uri = /vpc-routes
16942025-01-09T01:56:04.452ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
16952025-01-09T01:56:04.453ZINFOSledAgent (bootstore): Writing ledger to /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16962025-01-09T01:56:04.454ZINFOSledAgent (bootstore): Writing ledger to /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
16972025-01-09T01:56:04.455ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
16982025-01-09T01:56:04.455ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5658 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53926 req_id = 5b0ee7c9-51bb-48a8-a02c-e12056c052a4 response_code = 204 uri = /network-bootstore-config
16992025-01-09T01:56:04.457ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
17002025-01-09T01:56:04.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123158 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:44741 req_id = 7cda0d86-0cae-4d12-8c94-80151c9e973d response_code = 204 uri = /switch-ports
17012025-01-09T01:56:04.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44741 req_id = 48ff26b3-2cb4-4034-8925-8bb9362ca0e2 response_code = 200 uri = /network-bootstore-config
17022025-01-09T01:56:05.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46808
17032025-01-09T01:56:05.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46808 req_id = e757966a-35c5-4f15-9261-e7bf72fd5839 response_code = 200 uri = /vpc-routes
17042025-01-09T01:56:05.295ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
17052025-01-09T01:56:05.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46808 req_id = 6a7234f8-9eb2-4125-9d0e-9c8ac48ec48a response_code = 204 uri = /eip-gateways
17062025-01-09T01:56:05.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46808 req_id = 45a96859-2156-437d-b30a-056f0e9e3e6d response_code = 204 uri = /vpc-routes
17072025-01-09T01:56:05.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37264
17082025-01-09T01:56:05.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37264 req_id = 2c788ba9-20b8-49a9-9ded-a90fcaab33d3 response_code = 200 uri = /v2p
17092025-01-09T01:56:05.355ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46775
17102025-01-09T01:56:05.355ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
17112025-01-09T01:56:05.392ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
17122025-01-09T01:56:05.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87858 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:46775 req_id = 818478ab-2693-49cc-936e-b224476366de response_code = 204 uri = /switch-ports
17132025-01-09T01:56:05.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46775 req_id = 4b7bd65a-d230-4e02-b287-f572c7731c5f response_code = 200 uri = /network-bootstore-config
17142025-01-09T01:56:05.660ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43882
17152025-01-09T01:56:05.660ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43882 req_id = dcd07bff-54b4-4966-8d34-3c771f0b6d24 response_code = 200 uri = /vpc-routes
17162025-01-09T01:56:05.729ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
17172025-01-09T01:56:05.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43882 req_id = 4f721fda-6ec4-433c-89da-2192baab72c8 response_code = 204 uri = /eip-gateways
17182025-01-09T01:56:05.739ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43882 req_id = 78edb60f-5972-4c9c-bf5b-0d4dc40d136a response_code = 204 uri = /vpc-routes
17192025-01-09T01:56:17.677ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:49866 remote_addr = [fd00:1122:3344:101::d]:41409 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
17202025-01-09T01:56:17.709ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30328 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 765b8a4e-fc41-45de-8aa2-0e21afcebd26 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
17212025-01-09T01:56:19.365ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:37618
17222025-01-09T01:56:19.365ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:37618 req_id = 40bb033a-4851-4ab6-9733-a184fba72395 response_code = 200 uri = /baseboard
17232025-01-09T01:56:33.741ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48118
17242025-01-09T01:56:33.742ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48118 req_id = 7624d342-8a8c-4f72-8564-5352c1b0d0af response_code = 200 uri = /vpc-routes
17252025-01-09T01:56:33.817ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
17262025-01-09T01:56:33.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48118 req_id = 55e41f27-dc59-4599-875f-b719be7552aa response_code = 204 uri = /eip-gateways
17272025-01-09T01:56:33.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48118 req_id = db138640-ca44-49db-a8fd-7a4bf0e454f3 response_code = 204 uri = /vpc-routes
17282025-01-09T01:56:33.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58609
17292025-01-09T01:56:33.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 35 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58609 req_id = 07721e85-4799-4916-9f55-ee286dcc2023 response_code = 200 uri = /vpc-routes
17302025-01-09T01:56:33.931ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33259
17312025-01-09T01:56:33.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33259 req_id = a76e8ed1-30aa-447e-96ee-c5ac1123c8bd response_code = 200 uri = /v2p
17322025-01-09T01:56:33.973ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
17332025-01-09T01:56:33.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58609 req_id = 8d116a19-8e2e-48e8-be43-3117539d9fe8 response_code = 204 uri = /eip-gateways
17342025-01-09T01:56:33.982ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58609 req_id = 88ad885c-950d-4c9d-8742-46022980b5b1 response_code = 204 uri = /vpc-routes
17352025-01-09T01:56:33.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65024
17362025-01-09T01:56:33.985ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
17372025-01-09T01:56:34.028ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
17382025-01-09T01:56:34.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98849 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65024 req_id = aae7d673-4ebf-497a-9fb5-5e241ec7535e response_code = 204 uri = /switch-ports
17392025-01-09T01:56:34.084ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63939
17402025-01-09T01:56:34.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65024 req_id = 5f4ba3b1-024c-4d8f-be46-72b0c72fbb44 response_code = 200 uri = /network-bootstore-config
17412025-01-09T01:56:34.085ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63939 req_id = 211117c6-9be6-4d18-89c8-2f7f248ccddd response_code = 200 uri = /v2p
17422025-01-09T01:56:34.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65378
17432025-01-09T01:56:34.261ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
17442025-01-09T01:56:34.296ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
17452025-01-09T01:56:34.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86961 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65378 req_id = c425a7e3-2c51-4845-96e0-6dc938ca2f7e response_code = 204 uri = /switch-ports
17462025-01-09T01:56:34.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65378 req_id = 49224013-a6a3-449e-9b3b-8f6b4194c9b7 response_code = 200 uri = /network-bootstore-config
17472025-01-09T01:56:35.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58592
17482025-01-09T01:56:35.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58592 req_id = d1f1ebb3-4ee2-4022-846d-49a99819b0e0 response_code = 200 uri = /vpc-routes
17492025-01-09T01:56:35.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47954
17502025-01-09T01:56:35.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47954 req_id = 9b2a196b-ef49-4cf0-9d30-0008a291c608 response_code = 200 uri = /v2p
17512025-01-09T01:56:35.584ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
17522025-01-09T01:56:35.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58592 req_id = 094c7bc0-e605-433d-a79b-d0e170d467ed response_code = 204 uri = /eip-gateways
17532025-01-09T01:56:35.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58592 req_id = 2bcb4d1f-8121-463b-b456-817bf73b67d5 response_code = 204 uri = /vpc-routes
17542025-01-09T01:56:35.760ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42035
17552025-01-09T01:56:35.760ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
17562025-01-09T01:56:35.799ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
17572025-01-09T01:56:35.853ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93236 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42035 req_id = 2a76d2a0-9dc7-4170-82f2-412ccdaabee4 response_code = 204 uri = /switch-ports
17582025-01-09T01:56:35.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42035 req_id = a63df8e8-d9a7-4ad6-8933-e51d85490b2c response_code = 200 uri = /network-bootstore-config
17592025-01-09T01:56:47.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8319 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = fbaffe1d-d0b0-4a5f-9d8b-759cb56a16a9 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
17602025-01-09T01:56:49.399ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60289
17612025-01-09T01:56:49.399ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60289 req_id = f9ab930b-edfd-43e9-9420-256f4e000d56 response_code = 200 uri = /baseboard
17622025-01-09T01:57:03.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46986
17632025-01-09T01:57:03.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46986 req_id = 1396fe84-3349-4aea-8899-f14413ac4c54 response_code = 200 uri = /vpc-routes
17642025-01-09T01:57:03.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44558
17652025-01-09T01:57:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 26 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44558 req_id = 92933a47-e7c5-4f7e-a5eb-4909b4e80836 response_code = 200 uri = /vpc-routes
17662025-01-09T01:57:03.795ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
17672025-01-09T01:57:03.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46986 req_id = 48aff623-1d21-4668-9ba5-6cb3cd3bb0b4 response_code = 204 uri = /eip-gateways
17682025-01-09T01:57:03.802ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
17692025-01-09T01:57:03.802ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44558 req_id = 0affce83-db14-4ca5-baa1-9f133adb44f7 response_code = 204 uri = /eip-gateways
17702025-01-09T01:57:03.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46986 req_id = f62e00da-2ca2-474c-b49c-9f3829e75669 response_code = 204 uri = /vpc-routes
17712025-01-09T01:57:03.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44558 req_id = fb9d72c7-e021-47cc-ae2d-9e5bb589909a response_code = 204 uri = /vpc-routes
17722025-01-09T01:57:03.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43289
17732025-01-09T01:57:03.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43289 req_id = ca176172-ac89-44a1-b063-b616978d5450 response_code = 200 uri = /v2p
17742025-01-09T01:57:03.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35788
17752025-01-09T01:57:03.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35788 req_id = 7e827685-0354-492c-a4ed-b064de055ab3 response_code = 200 uri = /v2p
17762025-01-09T01:57:03.976ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65002
17772025-01-09T01:57:03.976ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
17782025-01-09T01:57:04.014ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
17792025-01-09T01:57:04.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94535 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65002 req_id = 72110928-f516-4390-8f22-79d687ba99c3 response_code = 204 uri = /switch-ports
17802025-01-09T01:57:04.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64349
17812025-01-09T01:57:04.071ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
17822025-01-09T01:57:04.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65002 req_id = 126aa0ef-f144-4e10-b25d-6c90d1edfe38 response_code = 200 uri = /network-bootstore-config
17832025-01-09T01:57:04.106ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
17842025-01-09T01:57:04.158ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87829 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64349 req_id = 1997d729-73e2-4ff9-803c-e44eb60873ac response_code = 204 uri = /switch-ports
17852025-01-09T01:57:04.159ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64349 req_id = 99b39d5f-4a85-47e5-b73c-fe32a37e8c84 response_code = 200 uri = /network-bootstore-config
17862025-01-09T01:57:05.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57259
17872025-01-09T01:57:05.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57259 req_id = 6ca84fd3-fe7d-4fcb-9d03-c598d151ed44 response_code = 200 uri = /vpc-routes
17882025-01-09T01:57:05.162ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
17892025-01-09T01:57:05.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57259 req_id = 37a186bd-18c8-44d5-864b-10f46c2d7eb3 response_code = 204 uri = /eip-gateways
17902025-01-09T01:57:05.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57259 req_id = a2525a6d-a81a-4224-bd5c-83e576b2472f response_code = 204 uri = /vpc-routes
17912025-01-09T01:57:05.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36448
17922025-01-09T01:57:05.268ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
17932025-01-09T01:57:05.311ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
17942025-01-09T01:57:05.376ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36448 req_id = 0f7d9c3c-2af3-4ba5-845e-66103a2fb24b response_code = 204 uri = /switch-ports
17952025-01-09T01:57:05.376ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63132
17962025-01-09T01:57:05.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63132 req_id = 7f16725b-d39a-4fe2-8c38-63b5b320698c response_code = 200 uri = /v2p
17972025-01-09T01:57:05.377ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36448 req_id = 0e9dcb83-5ba4-41bf-84d6-c0d975a36a9f response_code = 200 uri = /network-bootstore-config
17982025-01-09T01:57:17.683ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6723 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = bac3689e-fbd8-4baa-a2f8-f6a2afcb8a75 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
17992025-01-09T01:57:19.433ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45907
18002025-01-09T01:57:19.433ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 77 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45907 req_id = 3c5e3a6b-09cf-45d4-b904-f8a50c56aeba response_code = 200 uri = /baseboard
18012025-01-09T01:57:33.822ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45946
18022025-01-09T01:57:33.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45946 req_id = aa18a13b-047a-4ce8-897c-8376b601629c response_code = 200 uri = /vpc-routes
18032025-01-09T01:57:33.895ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
18042025-01-09T01:57:33.895ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45946 req_id = 7fe8cf1b-e9f8-434e-a7df-fb1861f2a300 response_code = 204 uri = /eip-gateways
18052025-01-09T01:57:33.913ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45946 req_id = 8ca920ba-7aa9-427e-864b-b8e0945664aa response_code = 204 uri = /vpc-routes
18062025-01-09T01:57:33.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59447
18072025-01-09T01:57:33.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59447 req_id = 0ac347e1-3f1e-4cf9-9ad5-e0e21aeae89b response_code = 200 uri = /vpc-routes
18082025-01-09T01:57:33.981ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
18092025-01-09T01:57:33.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59447 req_id = 4bb5ac9b-29d5-4781-85ab-5d4b7466a2a3 response_code = 204 uri = /eip-gateways
18102025-01-09T01:57:34.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50459
18112025-01-09T01:57:34.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50459 req_id = d239fe6b-4465-4c6e-af6d-437bb7dfbdb8 response_code = 200 uri = /v2p
18122025-01-09T01:57:34.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59447 req_id = 676858a0-f4ad-42f6-ab4d-9fe9d4e6db3a response_code = 204 uri = /vpc-routes
18132025-01-09T01:57:34.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63833
18142025-01-09T01:57:34.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63833 req_id = 69635300-29b4-46a4-9fab-aafab005fe26 response_code = 200 uri = /v2p
18152025-01-09T01:57:34.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63835
18162025-01-09T01:57:34.170ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18172025-01-09T01:57:34.207ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18182025-01-09T01:57:34.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:63835 req_id = 1651c15a-397c-43f5-99a1-d907c23785a1 response_code = 204 uri = /switch-ports
18192025-01-09T01:57:34.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63835 req_id = a7fe9bca-14d7-42c5-aab0-bc30d24fbecd response_code = 200 uri = /network-bootstore-config
18202025-01-09T01:57:34.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55907
18212025-01-09T01:57:34.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18222025-01-09T01:57:34.325ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18232025-01-09T01:57:34.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84803 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55907 req_id = ef37cebf-0203-4350-b7ef-e198841d6b71 response_code = 204 uri = /switch-ports
18242025-01-09T01:57:34.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55907 req_id = 0686d032-cd8a-4349-9320-56f58e58a384 response_code = 200 uri = /network-bootstore-config
18252025-01-09T01:57:35.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34862
18262025-01-09T01:57:35.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34862 req_id = 04a340a8-4e97-46d7-892a-f4eca1892688 response_code = 200 uri = /vpc-routes
18272025-01-09T01:57:35.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
18282025-01-09T01:57:35.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34862 req_id = 937ead7b-bdfe-4400-9ac4-794b84250194 response_code = 204 uri = /eip-gateways
18292025-01-09T01:57:35.409ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52249
18302025-01-09T01:57:35.409ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52249 req_id = 08157562-69fc-42e6-b3e6-ba6b0b279adc response_code = 200 uri = /v2p
18312025-01-09T01:57:35.418ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34862 req_id = ccb74657-7ae3-49c3-b458-c820a3600730 response_code = 204 uri = /vpc-routes
18322025-01-09T01:57:35.564ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60366
18332025-01-09T01:57:35.564ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18342025-01-09T01:57:35.603ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18352025-01-09T01:57:35.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93318 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:60366 req_id = f35ae082-f43e-418d-a007-f5ae40138efe response_code = 204 uri = /switch-ports
18362025-01-09T01:57:35.658ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60366 req_id = 89ffa526-6289-4e86-b20e-47992d6136bd response_code = 200 uri = /network-bootstore-config
18372025-01-09T01:57:47.686ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9727 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 8f9001b4-170f-419b-ab7f-f5d73c876dcf response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
18382025-01-09T01:57:49.467ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64778
18392025-01-09T01:57:49.467ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64778 req_id = 36107630-6003-4dcd-9bee-d25bfffc902d response_code = 200 uri = /baseboard
18402025-01-09T01:58:03.794ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59845
18412025-01-09T01:58:03.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59845 req_id = 21803d6b-f0fa-4eb0-abef-611ef53de603 response_code = 200 uri = /vpc-routes
18422025-01-09T01:58:03.820ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
18432025-01-09T01:58:03.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59845 req_id = 6f7b7484-6d93-4443-a0d0-984fc9260b74 response_code = 204 uri = /eip-gateways
18442025-01-09T01:58:03.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 292 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59845 req_id = c6856948-abaf-4d60-9476-4f1edb05787c response_code = 204 uri = /vpc-routes
18452025-01-09T01:58:03.829ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45803
18462025-01-09T01:58:03.829ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45803 req_id = 62a361a3-cad7-4132-a613-5f387b5bf916 response_code = 200 uri = /vpc-routes
18472025-01-09T01:58:03.836ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52017
18482025-01-09T01:58:03.836ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18492025-01-09T01:58:03.873ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18502025-01-09T01:58:03.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95730 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52017 req_id = 57e9da58-ddd7-44a4-b9fb-933263d9b853 response_code = 204 uri = /switch-ports
18512025-01-09T01:58:03.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41662
18522025-01-09T01:58:03.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34470
18532025-01-09T01:58:03.932ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34665
18542025-01-09T01:58:03.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 330 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52017 req_id = ece363c5-50a7-4428-9ee8-02ce9b60f357 response_code = 200 uri = /network-bootstore-config
18552025-01-09T01:58:03.932ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18562025-01-09T01:58:03.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 4113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41662 req_id = ab548226-8405-4174-9a00-3259c9c23c9e response_code = 200 uri = /v2p
18572025-01-09T01:58:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 741 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34470 req_id = 0124d325-e7fd-4609-837c-f0491fc676d2 response_code = 200 uri = /v2p
18582025-01-09T01:58:03.967ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
18592025-01-09T01:58:03.967ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45803 req_id = 7b1cb200-28e1-4eb0-b789-d2cb1ca1b26f response_code = 204 uri = /eip-gateways
18602025-01-09T01:58:03.971ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18612025-01-09T01:58:03.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 542 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45803 req_id = 4862b5e6-1150-4b49-b338-c28db65e30f9 response_code = 204 uri = /vpc-routes
18622025-01-09T01:58:04.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100307 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:34665 req_id = 194b0dc0-1535-43d6-98a1-e29e0898094d response_code = 204 uri = /switch-ports
18632025-01-09T01:58:04.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34665 req_id = 464aa036-e8a2-4219-8e63-df2e416a34ee response_code = 200 uri = /network-bootstore-config
18642025-01-09T01:58:05.259ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63020
18652025-01-09T01:58:05.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63020 req_id = fce8faf8-3502-4762-b705-d531eb25abe7 response_code = 200 uri = /vpc-routes
18662025-01-09T01:58:05.310ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
18672025-01-09T01:58:05.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63020 req_id = 379d1c7f-87ea-4ff4-9dc5-f00893dc1c6a response_code = 204 uri = /eip-gateways
18682025-01-09T01:58:05.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63020 req_id = 86e320a7-b369-4639-9e63-1cc4083fd2fd response_code = 204 uri = /vpc-routes
18692025-01-09T01:58:05.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43164
18702025-01-09T01:58:05.324ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18712025-01-09T01:58:05.365ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18722025-01-09T01:58:05.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98747 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43164 req_id = c732bf46-4442-4be1-99d5-2d39a92dac42 response_code = 204 uri = /switch-ports
18732025-01-09T01:58:05.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33866
18742025-01-09T01:58:05.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43164 req_id = 7d0266c4-49a6-4011-b0cb-87e14348304f response_code = 200 uri = /network-bootstore-config
18752025-01-09T01:58:05.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33866 req_id = 08e51885-6133-41b0-a4a8-b672f987a178 response_code = 200 uri = /v2p
18762025-01-09T01:58:17.684ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7244 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 510a0aa9-0069-4b78-83f0-da70d86a42b6 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
18772025-01-09T01:58:19.500ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53310
18782025-01-09T01:58:19.500ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53310 req_id = 91ee43e4-8a28-476b-b8b0-5b772ed0e7ba response_code = 200 uri = /baseboard
18792025-01-09T01:58:27.489ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
18802025-01-09T01:58:33.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34006
18812025-01-09T01:58:33.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34006 req_id = 4a3182f9-e998-416b-b41a-1d6fc837892d response_code = 200 uri = /vpc-routes
18822025-01-09T01:58:33.999ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
18832025-01-09T01:58:33.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34006 req_id = 9c999a0a-5921-4fdd-a727-c8193a0914e0 response_code = 204 uri = /eip-gateways
18842025-01-09T01:58:33.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33105
18852025-01-09T01:58:33.999ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33105 req_id = f8073c20-22d5-483f-9bf7-0afdc3bcc261 response_code = 200 uri = /vpc-routes
18862025-01-09T01:58:34.047ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
18872025-01-09T01:58:34.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33105 req_id = 148849cc-4eea-4fcc-8679-82c837792557 response_code = 204 uri = /eip-gateways
18882025-01-09T01:58:34.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33105 req_id = 6e0ad98f-9404-47e5-a1b4-0404a684b987 response_code = 204 uri = /vpc-routes
18892025-01-09T01:58:34.088ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52178
18902025-01-09T01:58:34.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52178 req_id = af88284b-353c-4641-876a-46ea06722479 response_code = 200 uri = /v2p
18912025-01-09T01:58:34.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34006 req_id = 6a235df8-abb7-4a23-8c98-7aa4faaebb40 response_code = 204 uri = /vpc-routes
18922025-01-09T01:58:34.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44166
18932025-01-09T01:58:34.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44166 req_id = 5b6dc937-2555-4668-a22f-9d2121cf5a34 response_code = 200 uri = /v2p
18942025-01-09T01:58:34.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65095
18952025-01-09T01:58:34.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
18962025-01-09T01:58:34.187ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
18972025-01-09T01:58:34.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 95979 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65095 req_id = 05851d3f-7fff-4fd6-888e-eb3e78ceae0c response_code = 204 uri = /switch-ports
18982025-01-09T01:58:34.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61747
18992025-01-09T01:58:34.245ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19002025-01-09T01:58:34.275ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19012025-01-09T01:58:34.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 80893 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61747 req_id = 79464716-f175-4b41-b9c5-52280bb1f6b1 response_code = 204 uri = /switch-ports
19022025-01-09T01:58:34.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65095 req_id = b2898ebe-7304-4ea0-a8ef-bf69a035eb1c response_code = 200 uri = /network-bootstore-config
19032025-01-09T01:58:34.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61747 req_id = 121a90ce-d697-4445-93a0-739fe3f83a07 response_code = 200 uri = /network-bootstore-config
19042025-01-09T01:58:35.274ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53512
19052025-01-09T01:58:35.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53512 req_id = b18ee8b1-7e98-499f-8bf0-18dcc472c505 response_code = 200 uri = /vpc-routes
19062025-01-09T01:58:35.317ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
19072025-01-09T01:58:35.317ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53512 req_id = 67440194-76a8-4f8c-8a46-cb47c553ca90 response_code = 204 uri = /eip-gateways
19082025-01-09T01:58:35.432ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47696
19092025-01-09T01:58:35.432ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47696 req_id = 495d7dec-3826-4c6a-b192-481066d52f56 response_code = 200 uri = /v2p
19102025-01-09T01:58:35.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53512 req_id = 11cc0a70-ea87-415b-9bbc-75a98406e89f response_code = 204 uri = /vpc-routes
19112025-01-09T01:58:35.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65148
19122025-01-09T01:58:35.505ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19132025-01-09T01:58:35.542ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19142025-01-09T01:58:35.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90934 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65148 req_id = c670c902-5ecb-448c-9fb3-4b5f96a6f8d0 response_code = 204 uri = /switch-ports
19152025-01-09T01:58:35.596ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65148 req_id = bbc9a5bb-f2b7-4b13-a602-1f2d502f6802 response_code = 200 uri = /network-bootstore-config
19162025-01-09T01:58:47.683ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6853 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = fe356dc3-d400-4e53-8b9d-e9370db5e534 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
19172025-01-09T01:58:49.536ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65522
19182025-01-09T01:58:49.536ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65522 req_id = b10e816d-e42a-431b-a42b-f4ebec3f9139 response_code = 200 uri = /baseboard
19192025-01-09T01:59:03.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57361
19202025-01-09T01:59:03.679ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57361 req_id = 2b5cf405-0c86-4bae-98d8-0b4c2c063235 response_code = 200 uri = /vpc-routes
19212025-01-09T01:59:03.743ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
19222025-01-09T01:59:03.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57361 req_id = b53d4e72-52a7-49cf-a3be-b72945cfa134 response_code = 204 uri = /eip-gateways
19232025-01-09T01:59:03.780ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54333
19242025-01-09T01:59:03.780ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54333 req_id = 3322e833-1dc1-481c-8abc-ca5bf4f24efc response_code = 200 uri = /v2p
19252025-01-09T01:59:03.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57361 req_id = 2e54236c-47a8-4197-b407-b087f18b82c3 response_code = 204 uri = /vpc-routes
19262025-01-09T01:59:03.792ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45717
19272025-01-09T01:59:03.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 22 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45717 req_id = 3ff94a79-8610-4214-8a94-82c22b8bed7e response_code = 200 uri = /vpc-routes
19282025-01-09T01:59:03.827ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56664
19292025-01-09T01:59:03.827ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19302025-01-09T01:59:03.866ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19312025-01-09T01:59:03.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99857 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56664 req_id = 5cf8714c-d562-4548-ab7b-b79c07084081 response_code = 204 uri = /switch-ports
19322025-01-09T01:59:03.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56384
19332025-01-09T01:59:03.927ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37930
19342025-01-09T01:59:03.927ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
19352025-01-09T01:59:03.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45717 req_id = 3cda76bd-1d37-43c4-8afa-d055e898b999 response_code = 204 uri = /eip-gateways
19362025-01-09T01:59:03.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 277 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56384 req_id = 7bfd1a61-0a3f-440b-b8a3-f88764da96f4 response_code = 200 uri = /v2p
19372025-01-09T01:59:03.927ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56664 req_id = 67120faa-a24f-4882-90c6-517fb748efb0 response_code = 200 uri = /network-bootstore-config
19382025-01-09T01:59:03.927ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19392025-01-09T01:59:03.937ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 376 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45717 req_id = 6317d329-500e-4ad8-a7b9-8328c0e5581d response_code = 204 uri = /vpc-routes
19402025-01-09T01:59:03.968ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19412025-01-09T01:59:04.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103298 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37930 req_id = d38672e5-f40b-462e-a2df-fd90a378f425 response_code = 204 uri = /switch-ports
19422025-01-09T01:59:04.031ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37930 req_id = 9496e946-770c-42ba-a99f-f070e84a3e19 response_code = 200 uri = /network-bootstore-config
19432025-01-09T01:59:05.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42356
19442025-01-09T01:59:05.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42356 req_id = 35ce06fa-d9ba-4169-9469-3785fcc394d7 response_code = 200 uri = /vpc-routes
19452025-01-09T01:59:05.132ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
19462025-01-09T01:59:05.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42356 req_id = cc35e659-20a6-449b-9254-dcb5da8b9450 response_code = 204 uri = /eip-gateways
19472025-01-09T01:59:05.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64067
19482025-01-09T01:59:05.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64067 req_id = fbae2d3c-e07b-4782-994c-dea566c99fe2 response_code = 200 uri = /v2p
19492025-01-09T01:59:05.153ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42356 req_id = 65dab79c-fd17-4288-ae09-4e2fe82315d9 response_code = 204 uri = /vpc-routes
19502025-01-09T01:59:05.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58981
19512025-01-09T01:59:05.192ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19522025-01-09T01:59:05.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19532025-01-09T01:59:05.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96411 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58981 req_id = 860b9e6e-e7ab-4a67-91e6-09da6daa452a response_code = 204 uri = /switch-ports
19542025-01-09T01:59:05.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58981 req_id = 5d857571-a9b5-45ac-9e6d-f4e09a47e4c7 response_code = 200 uri = /network-bootstore-config
19552025-01-09T01:59:17.689ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12356 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 57273bfc-9ae7-4132-a8d7-3a8a638b30bb response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
19562025-01-09T01:59:19.568ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45384
19572025-01-09T01:59:19.568ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45384 req_id = e1e20e2b-0109-49d5-9014-bde41fb31f3d response_code = 200 uri = /baseboard
19582025-01-09T01:59:33.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57815
19592025-01-09T01:59:33.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57815 req_id = e69ac86b-a499-4866-b7ff-4a491ae41cff response_code = 200 uri = /vpc-routes
19602025-01-09T01:59:33.815ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
19612025-01-09T01:59:33.815ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 713 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57815 req_id = 98d0dd4b-2fa7-4bb0-b2df-710a2e0d2d98 response_code = 204 uri = /eip-gateways
19622025-01-09T01:59:33.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:57815 req_id = 2d23284a-d36e-49c7-bf86-fd4ed42795a0 response_code = 204 uri = /vpc-routes
19632025-01-09T01:59:34.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60608
19642025-01-09T01:59:34.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60608 req_id = 324ec4eb-c965-4032-80ed-18bf241d8b81 response_code = 200 uri = /vpc-routes
19652025-01-09T01:59:34.065ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
19662025-01-09T01:59:34.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60608 req_id = 2dca576f-54d0-4f0d-9973-fabfbf7e88e9 response_code = 204 uri = /eip-gateways
19672025-01-09T01:59:34.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60608 req_id = 64bf1cb6-d813-458d-b46b-737b8a134a53 response_code = 204 uri = /vpc-routes
19682025-01-09T01:59:34.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61025
19692025-01-09T01:59:34.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61025 req_id = b343cf5e-c48d-4b04-b66b-dfe6d912c0fb response_code = 200 uri = /v2p
19702025-01-09T01:59:34.115ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62174
19712025-01-09T01:59:34.115ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19722025-01-09T01:59:34.161ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19732025-01-09T01:59:34.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 110798 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62174 req_id = 41514d7f-bb30-4b1e-91a1-d1e0b1ec5095 response_code = 204 uri = /switch-ports
19742025-01-09T01:59:34.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47544
19752025-01-09T01:59:34.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61653
19762025-01-09T01:59:34.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62174 req_id = 46188cd0-1198-456c-b8c5-c08591a1d7f5 response_code = 200 uri = /network-bootstore-config
19772025-01-09T01:59:34.227ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19782025-01-09T01:59:34.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47544 req_id = 31004b33-15e3-4915-8210-755ee6588a2b response_code = 200 uri = /v2p
19792025-01-09T01:59:34.270ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19802025-01-09T01:59:34.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102918 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61653 req_id = a8bf55a2-4872-4525-978e-961f0398353a response_code = 204 uri = /switch-ports
19812025-01-09T01:59:34.330ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61653 req_id = bf69ef84-22ee-409e-95fa-509170c38996 response_code = 200 uri = /network-bootstore-config
19822025-01-09T01:59:35.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55987
19832025-01-09T01:59:35.210ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55987 req_id = f8cffd16-7804-41c3-b53f-5566d2baabac response_code = 200 uri = /vpc-routes
19842025-01-09T01:59:35.270ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
19852025-01-09T01:59:35.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55987 req_id = 28dbbdf2-d098-4571-8a43-66d0b55301a0 response_code = 204 uri = /eip-gateways
19862025-01-09T01:59:35.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55987 req_id = 689aa4c2-ac63-4cfd-9523-7abe8885956b response_code = 204 uri = /vpc-routes
19872025-01-09T01:59:35.487ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51479
19882025-01-09T01:59:35.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51479 req_id = c5ed311d-c60b-4ff1-9852-a2a39be5a40a response_code = 200 uri = /v2p
19892025-01-09T01:59:35.526ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65338
19902025-01-09T01:59:35.526ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
19912025-01-09T01:59:35.564ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
19922025-01-09T01:59:35.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 93070 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65338 req_id = f712a1e7-fe59-4aed-94a1-44f37982cdb7 response_code = 204 uri = /switch-ports
19932025-01-09T01:59:35.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65338 req_id = 093307c5-38c3-42ce-a528-5a28792be916 response_code = 200 uri = /network-bootstore-config
19942025-01-09T01:59:47.684ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6669 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 9ec10522-3fbb-41fc-b33e-a04427e3b39b response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
19952025-01-09T01:59:49.601ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38029
19962025-01-09T01:59:49.601ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38029 req_id = 4f46db6c-1986-41dd-8599-c0511d892aed response_code = 200 uri = /baseboard
19972025-01-09T02:00:03.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37626
19982025-01-09T02:00:03.795ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37626 req_id = fd012bb1-f331-4f84-bf37-7f47c64c5848 response_code = 200 uri = /vpc-routes
19992025-01-09T02:00:03.810ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
20002025-01-09T02:00:03.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37626 req_id = d792b410-9e1c-46a3-a006-9a4c96d2835b response_code = 204 uri = /eip-gateways
20012025-01-09T02:00:03.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 240 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37626 req_id = 233dfc1b-3a1d-4193-98c8-a5e8bcc3e4b0 response_code = 204 uri = /vpc-routes
20022025-01-09T02:00:03.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33107
20032025-01-09T02:00:03.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33107 req_id = 7bbe5863-2423-4e9a-8d19-2f649b29af4a response_code = 200 uri = /v2p
20042025-01-09T02:00:03.894ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39079
20052025-01-09T02:00:03.894ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20062025-01-09T02:00:03.930ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20072025-01-09T02:00:03.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90597 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39079 req_id = 83c219f8-2e0d-4031-b195-9f428549c5f3 response_code = 204 uri = /switch-ports
20082025-01-09T02:00:03.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55560
20092025-01-09T02:00:03.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63554
20102025-01-09T02:00:03.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55560 req_id = f16b4275-2879-4775-9b8c-cd0e78afc092 response_code = 200 uri = /vpc-routes
20112025-01-09T02:00:03.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39079 req_id = ce9fc4b1-ac60-470f-a83d-bd3643fcb34b response_code = 200 uri = /network-bootstore-config
20122025-01-09T02:00:03.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63554 req_id = 6fc4195b-4980-479b-9db6-198cd3fef1c2 response_code = 200 uri = /v2p
20132025-01-09T02:00:03.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53462
20142025-01-09T02:00:03.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20152025-01-09T02:00:04.030ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20162025-01-09T02:00:04.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92323 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53462 req_id = fcb1f998-687a-4663-9282-7b32a119e8c0 response_code = 204 uri = /switch-ports
20172025-01-09T02:00:04.086ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
20182025-01-09T02:00:04.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55560 req_id = 019656b6-8e08-443f-9399-b636693f6756 response_code = 204 uri = /eip-gateways
20192025-01-09T02:00:04.087ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53462 req_id = a5252a98-ed93-4437-ae19-26f44e8714ad response_code = 200 uri = /network-bootstore-config
20202025-01-09T02:00:04.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55560 req_id = 8e97e2ab-b530-4135-ba27-c207b5c2c2a4 response_code = 204 uri = /vpc-routes
20212025-01-09T02:00:05.130ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39526
20222025-01-09T02:00:05.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39526 req_id = 88b6f916-73d7-472d-a3e4-6985c4e5f923 response_code = 200 uri = /vpc-routes
20232025-01-09T02:00:05.185ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
20242025-01-09T02:00:05.185ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39526 req_id = 01daddec-cdd6-4fed-a240-51c4a8b94a8b response_code = 204 uri = /eip-gateways
20252025-01-09T02:00:05.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39526 req_id = 6bec20f4-b042-4d9f-821e-2b35e35342de response_code = 204 uri = /vpc-routes
20262025-01-09T02:00:05.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53903
20272025-01-09T02:00:05.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53903 req_id = 8a9c22f1-39ad-43c7-98c3-ab2cfe4e85f1 response_code = 200 uri = /v2p
20282025-01-09T02:00:05.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64775
20292025-01-09T02:00:05.334ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20302025-01-09T02:00:05.370ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20312025-01-09T02:00:05.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 89521 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64775 req_id = 9a120d21-60ca-492c-9456-1592fa93b989 response_code = 204 uri = /switch-ports
20322025-01-09T02:00:05.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64775 req_id = b800a8d5-0d37-48c0-b60d-e13472f9e5af response_code = 200 uri = /network-bootstore-config
20332025-01-09T02:00:17.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7736 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = f5d537d9-ea5b-4eca-b812-900edd582f4a response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
20342025-01-09T02:00:19.633ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61978
20352025-01-09T02:00:19.633ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 74 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61978 req_id = b005f2dd-a454-4ad2-b7e9-65ddb2fca814 response_code = 200 uri = /baseboard
20362025-01-09T02:00:33.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45955
20372025-01-09T02:00:33.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45955 req_id = 2991369a-abac-48dd-bc04-7bd4ed61646f response_code = 200 uri = /vpc-routes
20382025-01-09T02:00:33.921ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
20392025-01-09T02:00:33.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45955 req_id = 737f8e74-78f5-427d-8fd4-fb0086d2410d response_code = 204 uri = /eip-gateways
20402025-01-09T02:00:33.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57368
20412025-01-09T02:00:33.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57368 req_id = f3f065f7-9622-4fd8-a136-5cf5e66e7506 response_code = 200 uri = /vpc-routes
20422025-01-09T02:00:33.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45955 req_id = 02daca02-391c-4fa6-a610-64602bb747c4 response_code = 204 uri = /vpc-routes
20432025-01-09T02:00:33.988ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
20442025-01-09T02:00:33.988ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57368 req_id = de5a2034-f766-4c38-ac76-48745f82251a response_code = 204 uri = /eip-gateways
20452025-01-09T02:00:33.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57368 req_id = 2f09e47a-9585-4660-a823-5ac74bc0245c response_code = 204 uri = /vpc-routes
20462025-01-09T02:00:34.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40939
20472025-01-09T02:00:34.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40939 req_id = 31c9abee-09e2-4240-99b4-34ca3d7f9008 response_code = 200 uri = /v2p
20482025-01-09T02:00:34.066ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63750
20492025-01-09T02:00:34.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63750 req_id = f9f44456-d564-40bf-9f04-7e86149bb854 response_code = 200 uri = /v2p
20502025-01-09T02:00:34.094ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58003
20512025-01-09T02:00:34.094ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20522025-01-09T02:00:34.137ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20532025-01-09T02:00:34.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58003 req_id = 208e1341-3831-4462-94ef-7cbc7086dd30 response_code = 204 uri = /switch-ports
20542025-01-09T02:00:34.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33275
20552025-01-09T02:00:34.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48459
20562025-01-09T02:00:34.195ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33428
20572025-01-09T02:00:34.195ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20582025-01-09T02:00:34.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58003 req_id = 1cd7f3d4-a0d7-4e3a-bb19-b9d449de5dab response_code = 200 uri = /network-bootstore-config
20592025-01-09T02:00:34.195ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20602025-01-09T02:00:34.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20612025-01-09T02:00:34.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20622025-01-09T02:00:34.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20632025-01-09T02:00:34.195ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20642025-01-09T02:00:34.195ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20652025-01-09T02:00:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20662025-01-09T02:00:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20672025-01-09T02:00:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20682025-01-09T02:00:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20692025-01-09T02:00:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20702025-01-09T02:00:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20712025-01-09T02:00:34.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5640 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33428 req_id = f4825972-5347-4be4-bbde-c6739c0d8c69 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20722025-01-09T02:00:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20732025-01-09T02:00:34.200ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20742025-01-09T02:00:34.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 5674 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:48459 req_id = 570a76d2-28c8-463f-ba22-ee42abf71f9b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20752025-01-09T02:00:34.236ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20762025-01-09T02:00:34.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102312 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33275 req_id = a6dc6177-7377-4e12-9cc5-1e0ee22ce704 response_code = 204 uri = /switch-ports
20772025-01-09T02:00:34.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33275 req_id = f85cfea8-fc2a-4d76-9904-fa4e622c59b8 response_code = 200 uri = /network-bootstore-config
20782025-01-09T02:00:35.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60099
20792025-01-09T02:00:35.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60099 req_id = 8ac1320b-fed2-4854-bee2-9f3fabbee51c response_code = 200 uri = /vpc-routes
20802025-01-09T02:00:35.259ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
20812025-01-09T02:00:35.259ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60099 req_id = 3dfcce5b-adad-4b1c-99c8-1329a682db39 response_code = 204 uri = /eip-gateways
20822025-01-09T02:00:35.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60099 req_id = aaaf7be8-87f3-4072-8181-a35116458252 response_code = 204 uri = /vpc-routes
20832025-01-09T02:00:35.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37331
20842025-01-09T02:00:35.375ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37331 req_id = b1cf726a-02b1-4af4-bb80-bb6063e3135b response_code = 200 uri = /v2p
20852025-01-09T02:00:35.402ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55514
20862025-01-09T02:00:35.402ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
20872025-01-09T02:00:35.445ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
20882025-01-09T02:00:35.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104089 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55514 req_id = 70868f40-890b-4765-a81f-b9aef1e2ccce response_code = 204 uri = /switch-ports
20892025-01-09T02:00:35.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55514 req_id = 5b470ddb-5923-45b9-b6c0-5ff75159276c response_code = 200 uri = /network-bootstore-config
20902025-01-09T02:00:35.580ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56328
20912025-01-09T02:00:35.580ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
20922025-01-09T02:00:35.580ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20932025-01-09T02:00:35.580ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20942025-01-09T02:00:35.580ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20952025-01-09T02:00:35.580ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
20962025-01-09T02:00:35.580ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
20972025-01-09T02:00:35.580ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
20982025-01-09T02:00:35.580ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 394 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56328 req_id = dc8b38be-0ae8-4ff3-b8ac-d795a6fc4c27 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
20992025-01-09T02:00:47.684ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6986 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 9fc43b70-7ff1-439f-acd4-3e32b5dde89b response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
21002025-01-09T02:00:49.668ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50116
21012025-01-09T02:00:49.668ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 72 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50116 req_id = e7d7cf3a-06a1-459d-b5aa-65dff39d4bee response_code = 200 uri = /baseboard
21022025-01-09T02:01:03.785ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56787
21032025-01-09T02:01:03.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56787 req_id = c9799b71-7945-4066-ae89-603847094059 response_code = 200 uri = /vpc-routes
21042025-01-09T02:01:03.799ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42773
21052025-01-09T02:01:03.799ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42773 req_id = 2ad588aa-e67d-4900-b614-74747483b275 response_code = 200 uri = /vpc-routes
21062025-01-09T02:01:03.816ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
21072025-01-09T02:01:03.816ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42773 req_id = b3e22cc4-a68d-4a19-84e1-9fc2093a2d77 response_code = 204 uri = /eip-gateways
21082025-01-09T02:01:03.824ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42773 req_id = 096ff72d-7dea-4c54-8b1f-d68334a9c98e response_code = 204 uri = /vpc-routes
21092025-01-09T02:01:03.825ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
21102025-01-09T02:01:03.825ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 27 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56787 req_id = 9c1a4522-2a05-4b21-b0fb-34429b98abe3 response_code = 204 uri = /eip-gateways
21112025-01-09T02:01:03.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43297
21122025-01-09T02:01:03.866ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21132025-01-09T02:01:03.908ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21142025-01-09T02:01:03.965ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99241 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:43297 req_id = 155bbd2a-c1ef-4efb-a506-e956db0d6a3b response_code = 204 uri = /switch-ports
21152025-01-09T02:01:03.965ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54973
21162025-01-09T02:01:03.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62982
21172025-01-09T02:01:03.966ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35172
21182025-01-09T02:01:03.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54973 req_id = bce31fac-e373-43d3-a83d-cfd8ff9e83f2 response_code = 200 uri = /v2p
21192025-01-09T02:01:03.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 462 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43297 req_id = dc816949-bd17-45e3-9c3c-77f47b35e131 response_code = 200 uri = /network-bootstore-config
21202025-01-09T02:01:03.966ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21212025-01-09T02:01:03.966ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 644 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56787 req_id = dc3f6e3e-57dd-4ef9-902e-ad652dc93636 response_code = 204 uri = /vpc-routes
21222025-01-09T02:01:03.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9921 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62982 req_id = e761f282-8b4c-4ca5-964d-8bcd4fc3ecf5 response_code = 200 uri = /v2p
21232025-01-09T02:01:04.009ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21242025-01-09T02:01:04.073ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107267 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35172 req_id = 49c52710-51d9-4a4e-abe7-d84c9710eaf7 response_code = 204 uri = /switch-ports
21252025-01-09T02:01:04.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35172 req_id = 2923681b-d065-48c2-9589-20419634fec3 response_code = 200 uri = /network-bootstore-config
21262025-01-09T02:01:05.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61012
21272025-01-09T02:01:05.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61012 req_id = 27631027-33ed-402c-867d-87168fbb33cf response_code = 200 uri = /vpc-routes
21282025-01-09T02:01:05.188ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
21292025-01-09T02:01:05.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61012 req_id = 7e806f19-0dbb-4704-8726-18cb9e7a8a58 response_code = 204 uri = /eip-gateways
21302025-01-09T02:01:05.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61012 req_id = a3938ef4-69c5-4ac9-9af8-6b3658fea4d7 response_code = 204 uri = /vpc-routes
21312025-01-09T02:01:05.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55650
21322025-01-09T02:01:05.219ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21332025-01-09T02:01:05.264ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21342025-01-09T02:01:05.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101953 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:55650 req_id = 09c4adfe-413a-441e-9f37-b5f5e63e879a response_code = 204 uri = /switch-ports
21352025-01-09T02:01:05.321ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53398
21362025-01-09T02:01:05.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53398 req_id = efc0fb34-2733-4115-83cb-453fefe41080 response_code = 200 uri = /v2p
21372025-01-09T02:01:05.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55650 req_id = 34e900e2-f9fe-4283-98c8-06e0703d0e65 response_code = 200 uri = /network-bootstore-config
21382025-01-09T02:01:17.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7489 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = ba9b53fc-79fe-40e4-b044-9018e258b3c8 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
21392025-01-09T02:01:19.700ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53361
21402025-01-09T02:01:19.701ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53361 req_id = b8a3e6e8-4041-4ace-ab03-367cc71891a5 response_code = 200 uri = /baseboard
21412025-01-09T02:01:33.924ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37592
21422025-01-09T02:01:33.924ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37592 req_id = 9390ecff-1332-4e6e-af40-2d2ab6d6bba1 response_code = 200 uri = /v2p
21432025-01-09T02:01:33.959ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47135
21442025-01-09T02:01:33.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47135 req_id = e793d29c-7d91-445c-9bab-70bfe66cfa4a response_code = 200 uri = /vpc-routes
21452025-01-09T02:01:34.011ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
21462025-01-09T02:01:34.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47135 req_id = 3a50edc1-c345-432c-a6b3-eaf9db04f87c response_code = 204 uri = /eip-gateways
21472025-01-09T02:01:34.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47135 req_id = f683e553-f469-4f42-bed5-59867a333977 response_code = 204 uri = /vpc-routes
21482025-01-09T02:01:34.057ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34530
21492025-01-09T02:01:34.057ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 23 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34530 req_id = 2eb0e398-c2a0-4484-8396-a04c90cbaa3c response_code = 200 uri = /vpc-routes
21502025-01-09T02:01:34.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48383
21512025-01-09T02:01:34.098ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21522025-01-09T02:01:34.136ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21532025-01-09T02:01:34.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94435 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48383 req_id = 3e599bd8-10c3-4eb3-81a1-b0b2745a7534 response_code = 204 uri = /switch-ports
21542025-01-09T02:01:34.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62245
21552025-01-09T02:01:34.192ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
21562025-01-09T02:01:34.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34530 req_id = 8c7e5835-80a8-4ce5-b8b3-9bb3ba86c74c response_code = 204 uri = /eip-gateways
21572025-01-09T02:01:34.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46279
21582025-01-09T02:01:34.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48383 req_id = b532e684-6e77-4f9c-af65-8f24cb7e7f55 response_code = 200 uri = /network-bootstore-config
21592025-01-09T02:01:34.193ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62245 req_id = 514a4c31-5c4c-4a2c-a46a-2a9cc5f5b470 response_code = 200 uri = /v2p
21602025-01-09T02:01:34.193ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21612025-01-09T02:01:34.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 368 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:34530 req_id = da8a3725-b401-4d23-86d9-56d71bb0dc11 response_code = 204 uri = /vpc-routes
21622025-01-09T02:01:34.233ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21632025-01-09T02:01:34.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98522 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:46279 req_id = ac1f8c82-1be1-4e9b-93a8-8a8e793051b2 response_code = 204 uri = /switch-ports
21642025-01-09T02:01:34.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46279 req_id = 6af3d049-1851-4baa-919d-6842975f1a94 response_code = 200 uri = /network-bootstore-config
21652025-01-09T02:01:35.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41227
21662025-01-09T02:01:35.286ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41227 req_id = 4f8ceacb-8989-4d06-af06-3ae66889af15 response_code = 200 uri = /vpc-routes
21672025-01-09T02:01:35.329ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
21682025-01-09T02:01:35.329ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41227 req_id = e19cde9b-55cd-4ec8-8028-a0106871c0cc response_code = 204 uri = /eip-gateways
21692025-01-09T02:01:35.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45182
21702025-01-09T02:01:35.342ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45182 req_id = 95ea8156-6d4c-4318-94ab-8c4786253297 response_code = 200 uri = /v2p
21712025-01-09T02:01:35.351ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 250 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41227 req_id = 0bff1619-5bd6-4ea0-93b7-82d77ff30f33 response_code = 204 uri = /vpc-routes
21722025-01-09T02:01:35.390ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41582
21732025-01-09T02:01:35.390ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21742025-01-09T02:01:35.432ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21752025-01-09T02:01:35.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100793 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41582 req_id = fc01f2c1-be10-4f57-b44e-8abfe7bba257 response_code = 204 uri = /switch-ports
21762025-01-09T02:01:35.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41582 req_id = 55d70114-52a8-44e0-bfe8-0a3ba646e792 response_code = 200 uri = /network-bootstore-config
21772025-01-09T02:01:47.685ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7306 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 1187c8cd-dbcc-4a14-81f9-8b08c8857fae response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
21782025-01-09T02:01:49.735ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49246
21792025-01-09T02:01:49.735ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 64 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49246 req_id = 773d4305-161e-4664-b62c-8d49594b231a response_code = 200 uri = /baseboard
21802025-01-09T02:02:03.755ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37467
21812025-01-09T02:02:03.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37467 req_id = d6e1f79b-19fa-4621-a43f-7b41e475356c response_code = 200 uri = /vpc-routes
21822025-01-09T02:02:03.804ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
21832025-01-09T02:02:03.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37467 req_id = 09450a28-63e1-4bed-9dc4-9f515a072c2b response_code = 204 uri = /eip-gateways
21842025-01-09T02:02:03.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 275 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37467 req_id = fbeac63a-e7cf-4d82-af16-e0bcb33a5fc6 response_code = 204 uri = /vpc-routes
21852025-01-09T02:02:03.904ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53497
21862025-01-09T02:02:03.904ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21872025-01-09T02:02:03.945ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21882025-01-09T02:02:04.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100654 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:53497 req_id = 4b37a923-7d12-433d-a558-c7eaaacbe7d2 response_code = 204 uri = /switch-ports
21892025-01-09T02:02:04.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61034
21902025-01-09T02:02:04.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59347
21912025-01-09T02:02:04.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53591
21922025-01-09T02:02:04.005ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
21932025-01-09T02:02:04.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61034 req_id = 402cbe63-ddf0-4d23-a882-4d155c148571 response_code = 200 uri = /vpc-routes
21942025-01-09T02:02:04.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53497 req_id = 784f1481-a73a-4c39-b6c0-06249da5fc70 response_code = 200 uri = /network-bootstore-config
21952025-01-09T02:02:04.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59347 req_id = 22543389-5dc3-4b0b-9a69-96e4d00156d1 response_code = 200 uri = /v2p
21962025-01-09T02:02:04.009ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34176
21972025-01-09T02:02:04.009ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34176 req_id = 8c7a9be3-4703-45fd-869b-e0996cd56432 response_code = 200 uri = /v2p
21982025-01-09T02:02:04.044ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
21992025-01-09T02:02:04.054ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
22002025-01-09T02:02:04.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61034 req_id = fa1c6c76-18bb-4bb8-bdb0-c59578444dec response_code = 204 uri = /eip-gateways
22012025-01-09T02:02:04.065ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61034 req_id = c5fe46af-bd92-4b12-9ba2-f52bff214ab7 response_code = 204 uri = /vpc-routes
22022025-01-09T02:02:04.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99300 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53591 req_id = d7cca849-415c-4ae4-9afb-40dcd3233e42 response_code = 204 uri = /switch-ports
22032025-01-09T02:02:04.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53591 req_id = 523737d7-c314-4318-a2a3-7f5f568918c3 response_code = 200 uri = /network-bootstore-config
22042025-01-09T02:02:05.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61405
22052025-01-09T02:02:05.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61405 req_id = cad549ce-4930-47b8-b669-88e1d65fbad1 response_code = 200 uri = /v2p
22062025-01-09T02:02:05.253ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58774
22072025-01-09T02:02:05.253ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 25 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58774 req_id = 04dcaf2f-e3c1-458a-be57-b3fb8ccf5531 response_code = 200 uri = /vpc-routes
22082025-01-09T02:02:05.297ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
22092025-01-09T02:02:05.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58774 req_id = c3d690a3-6919-43c2-875c-6bedb2a7b728 response_code = 204 uri = /eip-gateways
22102025-01-09T02:02:05.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58774 req_id = d9c11e51-0dd8-4c6f-aef6-9a7807d52898 response_code = 204 uri = /vpc-routes
22112025-01-09T02:02:05.307ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36434
22122025-01-09T02:02:05.307ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22132025-01-09T02:02:05.347ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22142025-01-09T02:02:05.405ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98230 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36434 req_id = 41d1df94-2679-4d28-a74a-d0195a2b5c4a response_code = 204 uri = /switch-ports
22152025-01-09T02:02:05.406ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36434 req_id = 911e4068-431b-48c3-bcf7-68afaada5fad response_code = 200 uri = /network-bootstore-config
22162025-01-09T02:02:17.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7776 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = a5330668-267d-46a8-abd4-e7720843061a response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
22172025-01-09T02:02:19.769ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32826
22182025-01-09T02:02:19.769ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 107 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32826 req_id = 84c7438a-ccd4-4d8b-a3cb-15ce06e0f6d1 response_code = 200 uri = /baseboard
22192025-01-09T02:02:34.043ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33156
22202025-01-09T02:02:34.043ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33156 req_id = acf062dc-1896-470a-9d6c-988dff0c759d response_code = 200 uri = /vpc-routes
22212025-01-09T02:02:34.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35331
22222025-01-09T02:02:34.054ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35331 req_id = cfbdb622-377e-45b3-b532-f1c7e13862c4 response_code = 200 uri = /vpc-routes
22232025-01-09T02:02:34.069ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
22242025-01-09T02:02:34.069ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35331 req_id = 6335d7a7-5f3e-4b8a-9c95-8594db2b9719 response_code = 204 uri = /eip-gateways
22252025-01-09T02:02:34.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35331 req_id = b3cfc2fb-c130-4d9d-8ca7-24ca15b33c18 response_code = 204 uri = /vpc-routes
22262025-01-09T02:02:34.090ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
22272025-01-09T02:02:34.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33156 req_id = 723267b4-b273-4ef0-8ae6-68ff80147194 response_code = 204 uri = /eip-gateways
22282025-01-09T02:02:34.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33156 req_id = 1a15669b-534f-4614-8c86-13a866a4c9b0 response_code = 204 uri = /vpc-routes
22292025-01-09T02:02:34.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58680
22302025-01-09T02:02:34.118ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22312025-01-09T02:02:34.160ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22322025-01-09T02:02:34.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98990 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58680 req_id = 6000f63d-257f-4d7f-8690-e4788d962f53 response_code = 204 uri = /switch-ports
22332025-01-09T02:02:34.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52316
22342025-01-09T02:02:34.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48730
22352025-01-09T02:02:34.217ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42506
22362025-01-09T02:02:34.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 314 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58680 req_id = cd58a1f8-9b23-4677-a893-08f103cd7a47 response_code = 200 uri = /network-bootstore-config
22372025-01-09T02:02:34.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42506 req_id = e18cfd30-a67a-438d-991d-608323165777 response_code = 200 uri = /v2p
22382025-01-09T02:02:34.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 262 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52316 req_id = 4e037495-18d2-4881-8979-ecd561b1853d response_code = 200 uri = /v2p
22392025-01-09T02:02:34.217ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22402025-01-09T02:02:34.257ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22412025-01-09T02:02:34.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96723 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48730 req_id = 2c9b7e8d-e202-46c2-9b90-2fd6dae04494 response_code = 204 uri = /switch-ports
22422025-01-09T02:02:34.314ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 146 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48730 req_id = a4233ec3-843f-4a34-b3bd-7abeed51a776 response_code = 200 uri = /network-bootstore-config
22432025-01-09T02:02:35.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47679
22442025-01-09T02:02:35.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47679 req_id = ee81a5ee-b039-4155-b7ce-68b78adfb016 response_code = 200 uri = /vpc-routes
22452025-01-09T02:02:35.371ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
22462025-01-09T02:02:35.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47679 req_id = 9cc9e5e1-833f-44f8-b2c7-ddfdb752d7a7 response_code = 204 uri = /eip-gateways
22472025-01-09T02:02:35.426ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37811
22482025-01-09T02:02:35.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37811 req_id = 4771f0dd-2322-4009-93ac-c09662ccdba7 response_code = 200 uri = /v2p
22492025-01-09T02:02:35.434ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47679 req_id = 48a11bb8-9fa1-42f1-96ce-7d12d218e06c response_code = 204 uri = /vpc-routes
22502025-01-09T02:02:35.449ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63817
22512025-01-09T02:02:35.449ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22522025-01-09T02:02:35.490ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22532025-01-09T02:02:35.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96741 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63817 req_id = ed7c9eb7-286d-4b76-b357-34a8ce50cf0b response_code = 204 uri = /switch-ports
22542025-01-09T02:02:35.546ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63817 req_id = f5330eba-5382-4d9d-bb2c-29b9f39abb6a response_code = 200 uri = /network-bootstore-config
22552025-01-09T02:02:47.688ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7878 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = ab9527f9-ed1d-4dbc-b4e3-ba97884c4a70 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
22562025-01-09T02:02:49.803ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38850
22572025-01-09T02:02:49.803ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38850 req_id = 0b69550e-774e-4175-ab74-dee83f58ae18 response_code = 200 uri = /baseboard
22582025-01-09T02:03:03.797ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46337
22592025-01-09T02:03:03.797ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46337 req_id = 67d4f77a-9296-4578-98fa-356ffa6aacd9 response_code = 200 uri = /vpc-routes
22602025-01-09T02:03:03.832ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64433
22612025-01-09T02:03:03.832ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64433 req_id = 1cc2d27b-b3ad-40a8-90d4-8d0e60db818d response_code = 200 uri = /v2p
22622025-01-09T02:03:03.843ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
22632025-01-09T02:03:03.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46337 req_id = 32e90f3f-856e-4fc2-aeac-7e7655ae79d0 response_code = 204 uri = /eip-gateways
22642025-01-09T02:03:03.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58639
22652025-01-09T02:03:03.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58639 req_id = 4c5989ca-9e1d-4205-989c-defade35044c response_code = 200 uri = /vpc-routes
22662025-01-09T02:03:03.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46337 req_id = 5c01f177-700e-4d38-a2b8-8e6d69cbd1a1 response_code = 204 uri = /vpc-routes
22672025-01-09T02:03:03.891ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
22682025-01-09T02:03:03.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58639 req_id = b61e1678-2ba6-4fac-8b9a-fcc18ecc9b66 response_code = 204 uri = /eip-gateways
22692025-01-09T02:03:03.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51689
22702025-01-09T02:03:03.895ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22712025-01-09T02:03:03.934ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22722025-01-09T02:03:03.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94577 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51689 req_id = 4221b7e8-a0df-4509-945e-e328497e82fa response_code = 204 uri = /switch-ports
22732025-01-09T02:03:03.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61608
22742025-01-09T02:03:03.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57146
22752025-01-09T02:03:03.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51689 req_id = e4a01db9-48c2-4804-be53-6ad46d881936 response_code = 200 uri = /network-bootstore-config
22762025-01-09T02:03:03.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 468 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58639 req_id = d417939b-8a37-4b9f-85a9-5e1db1a5b13c response_code = 204 uri = /vpc-routes
22772025-01-09T02:03:03.991ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22782025-01-09T02:03:03.991ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61608 req_id = 49cf3aa0-121c-4360-8d26-d9b8a8066971 response_code = 200 uri = /v2p
22792025-01-09T02:03:04.027ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22802025-01-09T02:03:04.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91828 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57146 req_id = 454da541-48e6-4295-bdc4-d79876e3afdf response_code = 204 uri = /switch-ports
22812025-01-09T02:03:04.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57146 req_id = 95e12b2d-6297-48d9-b912-4fc7282cfd89 response_code = 200 uri = /network-bootstore-config
22822025-01-09T02:03:05.101ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39872
22832025-01-09T02:03:05.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39872 req_id = f86c3c1e-b876-421a-b26b-4647f4eadfa7 response_code = 200 uri = /vpc-routes
22842025-01-09T02:03:05.117ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
22852025-01-09T02:03:05.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39872 req_id = c785a93e-2c08-4fce-acc1-f781ce223d16 response_code = 204 uri = /eip-gateways
22862025-01-09T02:03:05.188ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59926
22872025-01-09T02:03:05.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59926 req_id = 9ee4a20c-f477-474f-ad2f-b07aec33d752 response_code = 200 uri = /v2p
22882025-01-09T02:03:05.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39872 req_id = 70c10fca-1ca0-4711-b8d9-cbb4d2e00518 response_code = 204 uri = /vpc-routes
22892025-01-09T02:03:05.262ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33653
22902025-01-09T02:03:05.262ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
22912025-01-09T02:03:05.302ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
22922025-01-09T02:03:05.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94056 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33653 req_id = 70486f4a-3a54-4405-ad66-e445123f6998 response_code = 204 uri = /switch-ports
22932025-01-09T02:03:05.357ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33653 req_id = 84fc53b7-d113-4382-84dd-ea455ae9d0c2 response_code = 200 uri = /network-bootstore-config
22942025-01-09T02:03:13.210ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22952025-01-09T02:03:13.210ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22962025-01-09T02:03:13.240ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1716, tv_nsec: 114098437 } time_to_next_cleanup = 599.99999982s
22972025-01-09T02:03:17.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7123 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = c7f8c804-b5c8-4907-a012-1ac721c6e8f6 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
22982025-01-09T02:03:19.837ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54913
22992025-01-09T02:03:19.838ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54913 req_id = fc7172f7-cf82-43ce-95f8-927f844f4698 response_code = 200 uri = /baseboard
23002025-01-09T02:03:27.493ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23012025-01-09T02:03:33.906ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54554
23022025-01-09T02:03:33.906ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54554 req_id = 47e72e3a-e8a6-4e6d-905c-dea8b692bd65 response_code = 200 uri = /vpc-routes
23032025-01-09T02:03:33.955ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46935
23042025-01-09T02:03:33.956ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46935 req_id = 49d681b4-bd42-412e-9c16-8ac824999aad response_code = 200 uri = /vpc-routes
23052025-01-09T02:03:33.964ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
23062025-01-09T02:03:33.964ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54554 req_id = fec657ee-d2eb-48e2-bf0e-04b49e7fe718 response_code = 204 uri = /eip-gateways
23072025-01-09T02:03:33.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54554 req_id = 1403a67c-eb9d-4203-b2bd-258070738098 response_code = 204 uri = /vpc-routes
23082025-01-09T02:03:34.008ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
23092025-01-09T02:03:34.008ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46935 req_id = 34f12ee9-49c7-4119-bc6a-db7bb846512b response_code = 204 uri = /eip-gateways
23102025-01-09T02:03:34.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46935 req_id = f28e4049-c914-4345-bca7-ffe55b2e04cd response_code = 204 uri = /vpc-routes
23112025-01-09T02:03:34.031ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45226
23122025-01-09T02:03:34.032ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45226 req_id = 6b02b854-3fe4-44dd-8617-64e84421f41e response_code = 200 uri = /v2p
23132025-01-09T02:03:34.044ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37696
23142025-01-09T02:03:34.044ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23152025-01-09T02:03:34.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23162025-01-09T02:03:34.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 91556 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37696 req_id = 6a7a0d3d-0eec-4ecd-88b1-63a4cd9d1c30 response_code = 204 uri = /switch-ports
23172025-01-09T02:03:34.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57493
23182025-01-09T02:03:34.136ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41532
23192025-01-09T02:03:34.136ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23202025-01-09T02:03:34.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37696 req_id = 192cf425-e334-47e9-bab8-d33a8345a902 response_code = 200 uri = /network-bootstore-config
23212025-01-09T02:03:34.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3438 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57493 req_id = d7df672c-3904-45e6-abb3-0c7c60512213 response_code = 200 uri = /v2p
23222025-01-09T02:03:34.172ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23232025-01-09T02:03:34.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90427 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:41532 req_id = de851c67-f542-4e81-9771-d0bc8147bf04 response_code = 204 uri = /switch-ports
23242025-01-09T02:03:34.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41532 req_id = ef0a2b14-1f6e-499f-b2a2-43ef57502f87 response_code = 200 uri = /network-bootstore-config
23252025-01-09T02:03:35.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46952
23262025-01-09T02:03:35.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46952 req_id = b55b871a-699b-4ef2-85aa-d0ad892cae92 response_code = 200 uri = /vpc-routes
23272025-01-09T02:03:35.218ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
23282025-01-09T02:03:35.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46952 req_id = e7bfc0ea-9edc-44fb-a535-de933ddd0266 response_code = 204 uri = /eip-gateways
23292025-01-09T02:03:35.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46952 req_id = 2f6b7b69-2d21-4274-bb77-9c7ad1bdaa47 response_code = 204 uri = /vpc-routes
23302025-01-09T02:03:35.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38323
23312025-01-09T02:03:35.331ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38323 req_id = 7436800c-51c3-47be-b720-93d9e715c0a4 response_code = 200 uri = /v2p
23322025-01-09T02:03:35.445ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48580
23332025-01-09T02:03:35.446ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23342025-01-09T02:03:35.484ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23352025-01-09T02:03:35.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94371 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48580 req_id = e234eafa-bf09-4086-b00d-8d82918cc1b3 response_code = 204 uri = /switch-ports
23362025-01-09T02:03:35.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48580 req_id = 2631ca3e-9edf-49df-b600-15592a8f4801 response_code = 200 uri = /network-bootstore-config
23372025-01-09T02:03:47.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7086 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 3ce7cc8a-72a1-486e-ba31-bee32f0f1119 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
23382025-01-09T02:03:49.871ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:57270
23392025-01-09T02:03:49.872ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 92 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:57270 req_id = 21d62376-e060-40a9-b7b7-5b78c7edd9ee response_code = 200 uri = /baseboard
23402025-01-09T02:04:03.771ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54381
23412025-01-09T02:04:03.772ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 444 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54381 req_id = eb603519-7213-4e2f-af8b-4e977fcdcf24 response_code = 200 uri = /vpc-routes
23422025-01-09T02:04:03.779ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55950
23432025-01-09T02:04:03.779ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55950 req_id = 7e08265b-dd4f-4327-8891-86ada5b9e7c7 response_code = 200 uri = /vpc-routes
23442025-01-09T02:04:03.821ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
23452025-01-09T02:04:03.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54381 req_id = 91f12628-090e-475f-907c-90b0c7d0db42 response_code = 204 uri = /eip-gateways
23462025-01-09T02:04:03.826ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
23472025-01-09T02:04:03.826ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55950 req_id = 0583c25e-79f8-44c8-ae55-b9bf84883434 response_code = 204 uri = /eip-gateways
23482025-01-09T02:04:03.830ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54381 req_id = 9ef86a16-2dca-4a23-9900-934023c90a0e response_code = 204 uri = /vpc-routes
23492025-01-09T02:04:03.835ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55950 req_id = ad85c018-cb28-4606-a31e-89ac7ffff33e response_code = 204 uri = /vpc-routes
23502025-01-09T02:04:03.843ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53156
23512025-01-09T02:04:03.843ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53156 req_id = d169e42a-2afd-498d-8fec-8491ef206b7b response_code = 200 uri = /v2p
23522025-01-09T02:04:03.861ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50349
23532025-01-09T02:04:03.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50349 req_id = 7420673d-cf27-4a66-a21a-435ac6cc2991 response_code = 200 uri = /v2p
23542025-01-09T02:04:03.867ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35186
23552025-01-09T02:04:03.867ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23562025-01-09T02:04:03.907ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23572025-01-09T02:04:03.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 94402 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35186 req_id = f1b45753-42cd-4da4-b7e1-700df14e4d78 response_code = 204 uri = /switch-ports
23582025-01-09T02:04:03.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59387
23592025-01-09T02:04:03.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35186 req_id = 4318bb1f-e2b8-4684-87e7-e83041880ba7 response_code = 200 uri = /network-bootstore-config
23602025-01-09T02:04:03.962ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23612025-01-09T02:04:03.997ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23622025-01-09T02:04:04.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 84203 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59387 req_id = ed9dc1db-ae65-4f15-a6ac-a0257b76fb69 response_code = 204 uri = /switch-ports
23632025-01-09T02:04:04.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59387 req_id = d592766b-0fbe-4b54-b33a-8cddbfc50e23 response_code = 200 uri = /network-bootstore-config
23642025-01-09T02:04:05.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56351
23652025-01-09T02:04:05.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56351 req_id = a2b5f04e-cc27-4fc0-a4bd-5b42744c1b93 response_code = 200 uri = /vpc-routes
23662025-01-09T02:04:05.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
23672025-01-09T02:04:05.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56351 req_id = 8d3986bd-db2d-423b-9398-5e35ca12feba response_code = 204 uri = /eip-gateways
23682025-01-09T02:04:05.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56351 req_id = bbe832c0-e035-457f-86dc-487ef2f748fd response_code = 204 uri = /vpc-routes
23692025-01-09T02:04:05.242ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65181
23702025-01-09T02:04:05.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65181 req_id = cee601ee-2804-499f-a37e-2da6a116dc46 response_code = 200 uri = /v2p
23712025-01-09T02:04:05.244ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52119
23722025-01-09T02:04:05.244ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23732025-01-09T02:04:05.284ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23742025-01-09T02:04:05.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98195 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52119 req_id = ac3dca31-3d0d-416d-8cf2-9cf841c7eb9b response_code = 204 uri = /switch-ports
23752025-01-09T02:04:05.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52119 req_id = d226ff69-c2ac-4505-bbd2-9d79f4dc9892 response_code = 200 uri = /network-bootstore-config
23762025-01-09T02:04:17.688ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7578 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 6225f143-d7a4-4160-af12-c29a7d061416 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
23772025-01-09T02:04:19.905ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46388
23782025-01-09T02:04:19.905ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46388 req_id = 5d83d016-0cd8-4675-a91b-ab9a3255fd8e response_code = 200 uri = /baseboard
23792025-01-09T02:04:33.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53512
23802025-01-09T02:04:33.891ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53512 req_id = b597c91e-6d2c-4ac4-9354-b419d8fd9484 response_code = 200 uri = /vpc-routes
23812025-01-09T02:04:33.922ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43516
23822025-01-09T02:04:33.922ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43516 req_id = 482cf7c4-0613-456d-9674-386b17254817 response_code = 200 uri = /vpc-routes
23832025-01-09T02:04:33.939ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
23842025-01-09T02:04:33.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 3067574c-f5e8-4e49-8855-97c8269dcb50 response_code = 204 uri = /eip-gateways
23852025-01-09T02:04:33.939ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
23862025-01-09T02:04:33.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 19 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43516 req_id = 2ed2a18e-134c-473c-9ded-20118b6c8427 response_code = 204 uri = /eip-gateways
23872025-01-09T02:04:33.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53512 req_id = 32582e9a-7a53-432f-b8ae-f32dfdd58118 response_code = 204 uri = /vpc-routes
23882025-01-09T02:04:33.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 142 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43516 req_id = e22160b3-411e-422f-9f90-e123a4df90f7 response_code = 204 uri = /vpc-routes
23892025-01-09T02:04:34.000ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34458
23902025-01-09T02:04:34.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34458 req_id = b48a9d61-69cf-4ffb-84b3-ae6a6b4cfd37 response_code = 200 uri = /v2p
23912025-01-09T02:04:34.067ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53789
23922025-01-09T02:04:34.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53789 req_id = 9deedc48-ff54-4f64-af27-37c0e7f59847 response_code = 200 uri = /v2p
23932025-01-09T02:04:34.072ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50198
23942025-01-09T02:04:34.072ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23952025-01-09T02:04:34.112ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
23962025-01-09T02:04:34.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97446 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:50198 req_id = 9972796e-8bd9-4360-92db-1c30a7eb6457 response_code = 204 uri = /switch-ports
23972025-01-09T02:04:34.170ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62965
23982025-01-09T02:04:34.170ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
23992025-01-09T02:04:34.203ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24002025-01-09T02:04:34.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 81344 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62965 req_id = 31562e76-cebb-439a-9521-b369d812ec3e response_code = 204 uri = /switch-ports
24012025-01-09T02:04:34.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50198 req_id = 3b97ac2a-dd86-40c6-a707-a87ac423969d response_code = 200 uri = /network-bootstore-config
24022025-01-09T02:04:34.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62965 req_id = 3d4f4fdc-8f39-4f12-b971-06b1af81be52 response_code = 200 uri = /network-bootstore-config
24032025-01-09T02:04:35.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37990
24042025-01-09T02:04:35.292ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37990 req_id = 8e3d0a6f-772c-4ff8-9e3e-b2304ae074ea response_code = 200 uri = /vpc-routes
24052025-01-09T02:04:35.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
24062025-01-09T02:04:35.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37990 req_id = e31d850f-6763-47a7-b2de-562dfa1db11f response_code = 204 uri = /eip-gateways
24072025-01-09T02:04:35.364ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37990 req_id = 60171d5f-d90e-4506-bbfa-c4daab5d6b98 response_code = 204 uri = /vpc-routes
24082025-01-09T02:04:35.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38238
24092025-01-09T02:04:35.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38238 req_id = 1e08dacd-57aa-4794-b921-8564d3ab33ab response_code = 200 uri = /v2p
24102025-01-09T02:04:35.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39228
24112025-01-09T02:04:35.536ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24122025-01-09T02:04:35.578ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24132025-01-09T02:04:35.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99633 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39228 req_id = b53a239c-9831-4f68-bc35-731bb9b1371b response_code = 204 uri = /switch-ports
24142025-01-09T02:04:35.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39228 req_id = 0c08c912-48e7-412c-915e-fbe0a7613bc6 response_code = 200 uri = /network-bootstore-config
24152025-01-09T02:04:47.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7441 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = a032c628-bd96-4bc7-8e46-1cf02e1d9c01 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
24162025-01-09T02:04:49.938ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44099
24172025-01-09T02:04:49.939ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44099 req_id = 1e5e8a86-be37-4721-892e-4cb943164de7 response_code = 200 uri = /baseboard
24182025-01-09T02:05:03.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65502
24192025-01-09T02:05:03.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65502 req_id = 92053a7b-67d7-4565-b70c-1a494b138adf response_code = 200 uri = /vpc-routes
24202025-01-09T02:05:03.777ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
24212025-01-09T02:05:03.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65502 req_id = 4cfaf34d-a6d0-4ebf-8e8e-3c2a6f828284 response_code = 204 uri = /eip-gateways
24222025-01-09T02:05:03.785ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 276 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65502 req_id = ec58fb4e-d4cc-498c-bfc0-c0d38dfcb400 response_code = 204 uri = /vpc-routes
24232025-01-09T02:05:03.811ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44626
24242025-01-09T02:05:03.811ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44626 req_id = 7f643d91-e389-412b-82f6-82e665b626b1 response_code = 200 uri = /vpc-routes
24252025-01-09T02:05:03.854ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
24262025-01-09T02:05:03.854ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44626 req_id = dc87f692-e1c2-434a-b947-b67795665d51 response_code = 204 uri = /eip-gateways
24272025-01-09T02:05:03.864ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 281 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44626 req_id = 940c6589-69f6-4fd1-8f9c-cf344f183120 response_code = 204 uri = /vpc-routes
24282025-01-09T02:05:03.883ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61111
24292025-01-09T02:05:03.883ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24302025-01-09T02:05:03.924ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24312025-01-09T02:05:03.985ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101881 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61111 req_id = d9a9f5c5-16bd-4ce1-b12e-8034af4c4d37 response_code = 204 uri = /switch-ports
24322025-01-09T02:05:03.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40974
24332025-01-09T02:05:03.985ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56166
24342025-01-09T02:05:03.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61111 req_id = 2aac7762-cb26-41d0-93a6-6067ed8540a6 response_code = 200 uri = /network-bootstore-config
24352025-01-09T02:05:03.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56166 req_id = 1b0eac9e-509d-4e6c-b0c3-350b245b13c0 response_code = 200 uri = /v2p
24362025-01-09T02:05:03.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40974 req_id = cffa90e1-6a20-46d7-a9bb-6bcc4e663e68 response_code = 200 uri = /v2p
24372025-01-09T02:05:04.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49222
24382025-01-09T02:05:04.099ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24392025-01-09T02:05:04.137ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24402025-01-09T02:05:04.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96474 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49222 req_id = ba179d8f-3562-4656-887d-0625ac4839bc response_code = 204 uri = /switch-ports
24412025-01-09T02:05:04.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49222 req_id = b9f35aeb-17bb-47ff-acee-3ee3a4a7a140 response_code = 200 uri = /network-bootstore-config
24422025-01-09T02:05:05.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65406
24432025-01-09T02:05:05.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65406 req_id = a7c7fc08-4578-4678-a909-fe4a0a658df2 response_code = 200 uri = /vpc-routes
24442025-01-09T02:05:05.194ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
24452025-01-09T02:05:05.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65406 req_id = 4f0fb560-2187-4a5f-a5f5-a1f3a1504b3e response_code = 204 uri = /eip-gateways
24462025-01-09T02:05:05.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61239
24472025-01-09T02:05:05.196ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24482025-01-09T02:05:05.238ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24492025-01-09T02:05:05.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 97052 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:61239 req_id = 46ee4be2-f019-42f9-9a0d-1902fdc89b5d response_code = 204 uri = /switch-ports
24502025-01-09T02:05:05.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49571
24512025-01-09T02:05:05.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49571 req_id = 8c2425d5-4c70-49f8-853b-548f2302f21a response_code = 200 uri = /v2p
24522025-01-09T02:05:05.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 322 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61239 req_id = 06185629-684f-492e-ad17-71cf493d3144 response_code = 200 uri = /network-bootstore-config
24532025-01-09T02:05:05.294ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 557 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65406 req_id = 002bf1ca-fe1c-4f68-87ce-c0df25a5e90c response_code = 204 uri = /vpc-routes
24542025-01-09T02:05:17.689ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8658 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 2ccac9e0-553e-4a5c-a51a-1beab7962388 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
24552025-01-09T02:05:19.973ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44015
24562025-01-09T02:05:19.973ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44015 req_id = 1db4a8cb-6630-44ae-a1e5-8bd208539816 response_code = 200 uri = /baseboard
24572025-01-09T02:05:33.819ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41591
24582025-01-09T02:05:33.820ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41591 req_id = 72475491-5847-46b0-8c9a-77e553224062 response_code = 200 uri = /vpc-routes
24592025-01-09T02:05:33.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44827
24602025-01-09T02:05:33.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44827 req_id = fa818810-95c7-491c-bf9d-88934125ebce response_code = 200 uri = /vpc-routes
24612025-01-09T02:05:33.901ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
24622025-01-09T02:05:33.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41591 req_id = 54972a0a-bfa1-4764-8e57-52d784f460bb response_code = 204 uri = /eip-gateways
24632025-01-09T02:05:33.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 418 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41591 req_id = f04e17de-584f-4dbf-9b32-360a96cabdf8 response_code = 204 uri = /vpc-routes
24642025-01-09T02:05:33.944ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
24652025-01-09T02:05:33.944ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44827 req_id = e6a79447-ddaf-482a-bb41-fdfa99ba3157 response_code = 204 uri = /eip-gateways
24662025-01-09T02:05:34.090ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37094
24672025-01-09T02:05:34.090ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37094 req_id = c47757b9-bf43-49a3-8348-5dbf753613ac response_code = 200 uri = /v2p
24682025-01-09T02:05:34.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:44827 req_id = a8cbc950-7fa9-4cc0-82d1-c49a999a0244 response_code = 204 uri = /vpc-routes
24692025-01-09T02:05:34.129ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55490
24702025-01-09T02:05:34.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55490 req_id = 218b860d-8a63-400f-bcfd-84da0132325e response_code = 200 uri = /v2p
24712025-01-09T02:05:34.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50646
24722025-01-09T02:05:34.190ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24732025-01-09T02:05:34.190ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24742025-01-09T02:05:34.190ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:177
24752025-01-09T02:05:34.191ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:177
24762025-01-09T02:05:34.196ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37533
24772025-01-09T02:05:34.196ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
24782025-01-09T02:05:34.204ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24792025-01-09T02:05:34.204ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2414008d-221a-4a74-800b-eda0a3acdf4d
24802025-01-09T02:05:34.233ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24812025-01-09T02:05:34.233ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247
24822025-01-09T02:05:34.240ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
24832025-01-09T02:05:34.258ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24842025-01-09T02:05:34.258ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6f3f94ab-1776-457a-b887-7085a2c11828
24852025-01-09T02:05:34.269ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48232
24862025-01-09T02:05:34.271ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24872025-01-09T02:05:34.271ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
24882025-01-09T02:05:34.271ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:177
24892025-01-09T02:05:34.276ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:177
24902025-01-09T02:05:34.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43233
24912025-01-09T02:05:34.285ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
24922025-01-09T02:05:34.285ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8
24932025-01-09T02:05:34.286ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44495
24942025-01-09T02:05:34.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51855
24952025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
24962025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
24972025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24982025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
24992025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25002025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25012025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25022025-01-09T02:05:34.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 848 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44495 req_id = 953a10d6-cbdb-424e-8d00-44af4020f270 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25032025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25042025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25052025-01-09T02:05:34.295ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25062025-01-09T02:05:34.296ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25072025-01-09T02:05:34.296ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25082025-01-09T02:05:34.296ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25092025-01-09T02:05:34.296ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25102025-01-09T02:05:34.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 698 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:51855 req_id = 83cbc93e-e17f-4232-85e3-af1c55eee92a response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25112025-01-09T02:05:34.301ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25122025-01-09T02:05:34.301ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2414008d-221a-4a74-800b-eda0a3acdf4d
25132025-01-09T02:05:34.305ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25142025-01-09T02:05:34.306ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109525 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37533 req_id = 9f8c87b0-d353-43c2-b9cb-12c8e657a8fb response_code = 204 uri = /switch-ports
25152025-01-09T02:05:34.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 672 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37533 req_id = 59efc2fb-0372-405c-b37b-f738e801a260 response_code = 200 uri = /network-bootstore-config
25162025-01-09T02:05:34.330ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25172025-01-09T02:05:34.330ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247
25182025-01-09T02:05:34.346ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25192025-01-09T02:05:34.346ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3b35f00-104f-4cfc-b343-844e77de82c6
25202025-01-09T02:05:34.353ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25212025-01-09T02:05:34.362ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25222025-01-09T02:05:34.362ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6f3f94ab-1776-457a-b887-7085a2c11828
25232025-01-09T02:05:34.381ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25242025-01-09T02:05:34.381ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963
25252025-01-09T02:05:34.406ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25262025-01-09T02:05:34.406ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c
25272025-01-09T02:05:34.420ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25282025-01-09T02:05:34.420ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8
25292025-01-09T02:05:34.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 151416 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43233 req_id = 963a2e37-e00b-4da2-b8db-9593b53b94d0 response_code = 204 uri = /switch-ports
25302025-01-09T02:05:34.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43233 req_id = 3957f8fd-41fb-48a1-8dbd-9e33050b03ff response_code = 200 uri = /network-bootstore-config
25312025-01-09T02:05:34.437ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25322025-01-09T02:05:34.437ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3
25332025-01-09T02:05:34.450ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25342025-01-09T02:05:34.450ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3b35f00-104f-4cfc-b343-844e77de82c6
25352025-01-09T02:05:34.472ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25362025-01-09T02:05:34.472ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963
25372025-01-09T02:05:34.485ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25382025-01-09T02:05:34.485ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13
25392025-01-09T02:05:34.497ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 307190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50646 req_id = 062e9cb3-7d51-4f64-97ac-344ffe9766eb response_code = 200 uri = /inventory
25402025-01-09T02:05:34.499ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25412025-01-09T02:05:34.499ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c
25422025-01-09T02:05:34.521ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25432025-01-09T02:05:34.521ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3
25442025-01-09T02:05:34.541ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25452025-01-09T02:05:34.541ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13
25462025-01-09T02:05:34.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 283994 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48232 req_id = f0d2ded3-55eb-4d34-80d6-1fcd8185a3af response_code = 200 uri = /inventory
25472025-01-09T02:05:35.446ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55329
25482025-01-09T02:05:35.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55329 req_id = 9c847657-f987-46f0-b651-72a08950f23b response_code = 200 uri = /vpc-routes
25492025-01-09T02:05:35.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47570
25502025-01-09T02:05:35.451ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47570 req_id = 42388e85-cc58-4b36-9557-7e61d263fbb8 response_code = 200 uri = /v2p
25512025-01-09T02:05:35.488ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
25522025-01-09T02:05:35.488ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55329 req_id = 2a68882e-6d4b-43ca-836c-d1e4ddd2e0fa response_code = 204 uri = /eip-gateways
25532025-01-09T02:05:35.502ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59654
25542025-01-09T02:05:35.502ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 1c4ecb35-e21a-4acb-a24d-e64c920368a9, kind: Service { id: f0f2e5cd-2795-4686-a722-eff994bc2526 }, name: Name("external-dns-f0f2e5cd-2795-4686-a722-eff994bc2526"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 147, 207])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 895186f7-b090-4dae-808e-8be75d2b2d7b, kind: Service { id: f3416805-f40d-4d68-a19c-04a4a2965ebd }, name: Name("external-dns-f3416805-f40d-4d68-a19c-04a4a2965ebd"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 213, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 4f2d96ec-8d74-4498-99de-eb86f0ad9069, kind: Service { id: 529d4c5c-68f4-4868-89bd-83eaa1aa4e8b }, name: Name("nexus-529d4c5c-68f4-4868-89bd-83eaa1aa4e8b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 163, 75])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7903dd60-4f91-4fe6-bee8-c9f7f99c0a5d, kind: Service { id: c0a9365d-d13c-4032-a1ed-9ff69918b349 }, name: Name("nexus-c0a9365d-d13c-4032-a1ed-9ff69918b349"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 175, 128])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: c8cf1e65-92bd-4b41-87d3-99152d5ec281, kind: Service { id: e7344e32-c3b3-43f7-8c30-e8bae4108d33 }, name: Name("nexus-e7344e32-c3b3-43f7-8c30-e8bae4108d33"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 153, 1])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25552025-01-09T02:05:35.502ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25562025-01-09T02:05:35.502ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25572025-01-09T02:05:35.502ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25582025-01-09T02:05:35.502ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25592025-01-09T02:05:35.502ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25602025-01-09T02:05:35.502ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25612025-01-09T02:05:35.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59654 req_id = ee65d56e-1831-4142-8b90-c7e9a3125a78 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25622025-01-09T02:05:35.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62658
25632025-01-09T02:05:35.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25642025-01-09T02:05:35.506ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25652025-01-09T02:05:35.506ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/config/omicron-zones.json file = common/src/ledger.rs:177
25662025-01-09T02:05:35.507ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/config/omicron-zones.json file = common/src/ledger.rs:177
25672025-01-09T02:05:35.516ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 463 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55329 req_id = a56b296e-89d7-4467-9b29-aa8a0bfe080c response_code = 204 uri = /vpc-routes
25682025-01-09T02:05:35.520ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2414008d-221a-4a74-800b-eda0a3acdf4d (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25692025-01-09T02:05:35.520ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2414008d-221a-4a74-800b-eda0a3acdf4d
25702025-01-09T02:05:35.547ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2ab41312-6b08-4bf8-a0ad-e5e4e28f9247 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25712025-01-09T02:05:35.547ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2ab41312-6b08-4bf8-a0ad-e5e4e28f9247
25722025-01-09T02:05:35.571ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58864
25732025-01-09T02:05:35.571ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
25742025-01-09T02:05:35.574ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 6f3f94ab-1776-457a-b887-7085a2c11828 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25752025-01-09T02:05:35.575ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_6f3f94ab-1776-457a-b887-7085a2c11828
25762025-01-09T02:05:35.604ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: d4cb66ec-6ed9-4ece-810f-eb6a814417d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25772025-01-09T02:05:35.604ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_d4cb66ec-6ed9-4ece-810f-eb6a814417d8
25782025-01-09T02:05:35.614ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
25792025-01-09T02:05:35.631ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: e3b35f00-104f-4cfc-b343-844e77de82c6 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25802025-01-09T02:05:35.631ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_e3b35f00-104f-4cfc-b343-844e77de82c6
25812025-01-09T02:05:35.656ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: cd8783d0-a9a7-460f-ad3b-9c299005a963 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25822025-01-09T02:05:35.656ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_cd8783d0-a9a7-460f-ad3b-9c299005a963
25832025-01-09T02:05:35.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 105957 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58864 req_id = 7c067a9a-888b-4e8e-9b4c-c5d32e562bdb response_code = 204 uri = /switch-ports
25842025-01-09T02:05:35.677ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58864 req_id = 205830b9-e0ce-41fb-9586-800f427d3e04 response_code = 200 uri = /network-bootstore-config
25852025-01-09T02:05:35.681ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 9bcb5ffb-3c70-4a59-b16f-35f7144cb14c (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25862025-01-09T02:05:35.681ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_9bcb5ffb-3c70-4a59-b16f-35f7144cb14c
25872025-01-09T02:05:35.704ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: de68b76d-2647-4c21-9b4f-742a80c76ec3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25882025-01-09T02:05:35.704ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_de68b76d-2647-4c21-9b4f-742a80c76ec3
25892025-01-09T02:05:35.725ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b22ab4ae-5a19-4667-afb0-e2711a470b13 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25902025-01-09T02:05:35.725ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b22ab4ae-5a19-4667-afb0-e2711a470b13
25912025-01-09T02:05:35.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 230229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62658 req_id = e1d16f1a-137a-4a51-a6c9-10f87a542c60 response_code = 200 uri = /inventory
25922025-01-09T02:05:47.687ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7183 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 3dee8a69-4e37-45a1-a499-2ea7e83f06ca response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
25932025-01-09T02:05:50.007ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45160
25942025-01-09T02:05:50.007ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45160 req_id = a6711301-d9cf-4038-a84a-dca74bbf95d6 response_code = 200 uri = /baseboard
25952025-01-09T02:06:03.870ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57815
25962025-01-09T02:06:03.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57815 req_id = 855db876-3afb-4daa-b1f8-0510231ffbdb response_code = 200 uri = /vpc-routes
25972025-01-09T02:06:03.884ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
25982025-01-09T02:06:03.884ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57815 req_id = 7ede032f-4e31-4461-ace5-8913fc8ccd78 response_code = 204 uri = /eip-gateways
25992025-01-09T02:06:03.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36668
26002025-01-09T02:06:03.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36668 req_id = ee2059cf-5ad9-4751-9af1-121738a67e6c response_code = 200 uri = /vpc-routes
26012025-01-09T02:06:03.893ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57815 req_id = ddea6b9b-bcff-4347-9e94-466d13a68b65 response_code = 204 uri = /vpc-routes
26022025-01-09T02:06:03.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56848
26032025-01-09T02:06:03.901ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26042025-01-09T02:06:03.941ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26052025-01-09T02:06:04.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 102874 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56848 req_id = 2edbf912-0970-4277-9bc6-20901b62bd1c response_code = 204 uri = /switch-ports
26062025-01-09T02:06:04.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39715
26072025-01-09T02:06:04.004ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33893
26082025-01-09T02:06:04.005ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
26092025-01-09T02:06:04.005ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26102025-01-09T02:06:04.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 300 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36668 req_id = 348be22e-7af0-4f40-b379-a1f7e734a312 response_code = 204 uri = /eip-gateways
26112025-01-09T02:06:04.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 378 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56848 req_id = 5c27c686-1f7a-47ee-beea-e376a49e5c48 response_code = 200 uri = /network-bootstore-config
26122025-01-09T02:06:04.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33893 req_id = f2ccecdc-4ee5-463b-a36c-8398d9cf583f response_code = 200 uri = /v2p
26132025-01-09T02:06:04.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 345 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36668 req_id = 16074b09-54d9-4ff6-beee-10aba0a68db3 response_code = 204 uri = /vpc-routes
26142025-01-09T02:06:04.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44948
26152025-01-09T02:06:04.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44948 req_id = 62c64eff-e1d5-4d61-94d8-a62bd2b26cc7 response_code = 200 uri = /v2p
26162025-01-09T02:06:04.045ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26172025-01-09T02:06:04.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39715 req_id = 8a0e8f1f-189e-4a3b-abbe-27fec3e4604b response_code = 204 uri = /switch-ports
26182025-01-09T02:06:04.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39715 req_id = ad0f22f6-fbf2-4664-b24e-3971e90580e6 response_code = 200 uri = /network-bootstore-config
26192025-01-09T02:06:05.310ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59168
26202025-01-09T02:06:05.310ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59168 req_id = 0ed15ea3-cac2-436b-9960-f7b3a3df5da4 response_code = 200 uri = /vpc-routes
26212025-01-09T02:06:05.328ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
26222025-01-09T02:06:05.328ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59168 req_id = c0e29cd5-5a8f-4694-bb14-ad6817a99b37 response_code = 204 uri = /eip-gateways
26232025-01-09T02:06:05.383ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60122
26242025-01-09T02:06:05.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60122 req_id = a3dcf5ff-6f84-4276-beb4-f918ad9dc237 response_code = 200 uri = /v2p
26252025-01-09T02:06:05.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:59168 req_id = 3e5dca00-ebcd-4dab-85e9-825f98bfea4c response_code = 204 uri = /vpc-routes
26262025-01-09T02:06:05.399ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59074
26272025-01-09T02:06:05.399ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26282025-01-09T02:06:05.439ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26292025-01-09T02:06:05.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99329 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59074 req_id = 74ec2324-bcd5-4c2e-8be9-c5b552269e42 response_code = 204 uri = /switch-ports
26302025-01-09T02:06:05.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59074 req_id = 49df800e-66cf-4bd2-ba1b-1df0db6e2eca response_code = 200 uri = /network-bootstore-config
26312025-01-09T02:06:17.689ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8763 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 1c9c391d-073f-41cd-a388-5d2ed04c18f5 response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
26322025-01-09T02:06:20.040ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59753
26332025-01-09T02:06:20.041ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59753 req_id = 8992e379-5219-4576-8cfe-b09476769d58 response_code = 200 uri = /baseboard
26342025-01-09T02:06:29.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64070
26352025-01-09T02:06:29.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64070 req_id = 9f45aafe-c947-4ebd-aab5-4f25ac18ab5c response_code = 200 uri = /v2p
26362025-01-09T02:06:29.423ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(380956) }
26372025-01-09T02:06:29.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 701 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64070 req_id = 04ae67b0-b1f0-47f3-afe4-cec29301ea13 response_code = 204 uri = /v2p
26382025-01-09T02:06:29.547ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64534
26392025-01-09T02:06:29.554ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: eeab26b9-6b60-47d9-a432-ee824d0cce75, kind: Instance { id: f8f78731-17c8-42ec-be95-8f09a36ed5e5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(380956), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: eeab26b9-6b60-47d9-a432-ee824d0cce75, kind: Instance { id: f8f78731-17c8-42ec-be95-8f09a36ed5e5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(380956), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: eeab26b9-6b60-47d9-a432-ee824d0cce75, kind: Instance { id: f8f78731-17c8-42ec-be95-8f09a36ed5e5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(380956), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(380956))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: eeab26b9-6b60-47d9-a432-ee824d0cce75, kind: Instance { id: f8f78731-17c8-42ec-be95-8f09a36ed5e5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(380956), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 97434d8f-9dec-4c67-b559-65d690e108fb, slot: 0, read_only: false, vcr_json: .., name: "disk-b23aaf96615" }], boot_settings: Some(InstanceBootSettings { order: [97434d8f-9dec-4c67-b559-65d690e108fb] }), cloud_init_bytes: Some(..) } instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 metadata = InstanceMetadata { silo_id: c4549307-0727-4469-a91b-204d541346cb, project_id: 81aeb7cb-39f7-4333-8b69-942212358ff6 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-09T02:06:29.547034153Z }
26402025-01-09T02:06:29.554ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 migration_id = None propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
26412025-01-09T02:06:29.554ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1562 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 migration_id = None propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: eeab26b9-6b60-47d9-a432-ee824d0cce75, kind: Instance { id: f8f78731-17c8-42ec-be95-8f09a36ed5e5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(380956), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: eeab26b9-6b60-47d9-a432-ee824d0cce75, kind: Instance { id: f8f78731-17c8-42ec-be95-8f09a36ed5e5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(380956), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: eeab26b9-6b60-47d9-a432-ee824d0cce75, kind: Instance { id: f8f78731-17c8-42ec-be95-8f09a36ed5e5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(380956), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(380956))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: eeab26b9-6b60-47d9-a432-ee824d0cce75, kind: Instance { id: f8f78731-17c8-42ec-be95-8f09a36ed5e5 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(380956), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 97434d8f-9dec-4c67-b559-65d690e108fb, slot: 0, read_only: false, vcr_json: .., name: "disk-b23aaf96615" }], boot_settings: Some(InstanceBootSettings { order: [97434d8f-9dec-4c67-b559-65d690e108fb] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-09T02:06:29.547034153Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
26422025-01-09T02:06:29.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7562 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64534 req_id = 86814db7-2c91-4a5f-8e72-62f2e5d82a18 response_code = 200 uri = /vmms/467f52d1-1a36-4090-b3eb-c882200620bc
26432025-01-09T02:06:29.667ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53034
26442025-01-09T02:06:29.667ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 663 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:53034 req_id = 9f01347d-71dc-42f1-abf9-bad217f27e95 response_code = 200 uri = /vmms/467f52d1-1a36-4090-b3eb-c882200620bc/state
26452025-01-09T02:06:29.670ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 380956 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
26462025-01-09T02:06:29.670ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26472025-01-09T02:06:29.709ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc file = illumos-utils/src/zone.rs:325 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
26482025-01-09T02:06:29.733ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc file = illumos-utils/src/zone.rs:363 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
26492025-01-09T02:06:29.745ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38042
26502025-01-09T02:06:29.745ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38042 req_id = c68a0a3a-a328-4e53-8bf6-d04cd2146c7f response_code = 200 uri = /vpc-routes
26512025-01-09T02:06:29.768ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {eeab26b9-6b60-47d9-a432-ee824d0cce75: {10.151.2.176: {0f7ab0d9-8981-463e-b236-8f6e76c19564}, 10.151.2.175: {0f7ab0d9-8981-463e-b236-8f6e76c19564}}} }
26522025-01-09T02:06:31.370ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
26532025-01-09T02:06:31.370ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc zone file = illumos-utils/src/running_zone.rs:488 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc zone = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
26542025-01-09T02:06:31.571ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc") failed: Property not found. retry in 40.765383ms file = illumos-utils/src/svc.rs:36 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc zone = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
26552025-01-09T02:06:31.621ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc") failed: Property not found. retry in 132.207918ms file = illumos-utils/src/svc.rs:36 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc zone = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
26562025-01-09T02:06:31.770ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc") failed: Property not found. retry in 284.354768ms file = illumos-utils/src/svc.rs:36 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc zone = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
26572025-01-09T02:06:32.068ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc") failed: Property not found. retry in 482.573355ms file = illumos-utils/src/svc.rs:36 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc zone = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
26582025-01-09T02:06:32.567ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc") failed: Property not found. retry in 504.114307ms file = illumos-utils/src/svc.rs:36 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc zone = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
26592025-01-09T02:06:33.082ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc") failed: Property not found. retry in 1.458376853s file = illumos-utils/src/svc.rs:36 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc zone = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
26602025-01-09T02:06:33.844ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53232
26612025-01-09T02:06:33.844ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53232 req_id = f895af89-97db-461c-8cab-6a901238eae8 response_code = 200 uri = /vpc-routes
26622025-01-09T02:06:33.856ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50635
26632025-01-09T02:06:33.900ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54566
26642025-01-09T02:06:33.950ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {eeab26b9-6b60-47d9-a432-ee824d0cce75: {10.151.2.175: {0f7ab0d9-8981-463e-b236-8f6e76c19564}, 10.151.2.176: {0f7ab0d9-8981-463e-b236-8f6e76c19564}}} }
26652025-01-09T02:06:33.950ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53232 req_id = 9afe9c75-ca34-47cc-9dcb-f64db39b0dde response_code = 204 uri = /eip-gateways
26662025-01-09T02:06:34.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44431
26672025-01-09T02:06:34.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 31 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44431 req_id = c77d6b1e-126e-48c2-881b-3be22c397081 response_code = 200 uri = /vpc-routes
26682025-01-09T02:06:34.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {eeab26b9-6b60-47d9-a432-ee824d0cce75: {10.151.2.175: {0f7ab0d9-8981-463e-b236-8f6e76c19564}, 10.151.2.176: {0f7ab0d9-8981-463e-b236-8f6e76c19564}}} }
26692025-01-09T02:06:34.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44431 req_id = aa2d4c4d-d590-4121-83bf-9f78d18cc766 response_code = 204 uri = /eip-gateways
26702025-01-09T02:06:34.078ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38333
26712025-01-09T02:06:34.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 147 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38333 req_id = 9c06fef1-1384-4727-a4c5-0872dab0908e response_code = 200 uri = /v2p
26722025-01-09T02:06:34.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44558
26732025-01-09T02:06:34.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44558 req_id = 74dd4346-70ee-4606-820b-861ef46a036b response_code = 200 uri = /v2p
26742025-01-09T02:06:34.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 424 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53232 req_id = ced4e8d2-ebd3-4e79-a18f-c35afa17593c response_code = 204 uri = /vpc-routes
26752025-01-09T02:06:34.140ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64839
26762025-01-09T02:06:34.140ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26772025-01-09T02:06:34.180ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26782025-01-09T02:06:34.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 99846 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64839 req_id = 2e4ed4e0-4c58-4ca1-9402-786580f7570e response_code = 204 uri = /switch-ports
26792025-01-09T02:06:34.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50856
26802025-01-09T02:06:34.240ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: e4377979-e688-4cfc-9c46-df1d7adb7d95, version: 3 } old_vers = RouterVersion { router_id: e4377979-e688-4cfc-9c46-df1d7adb7d95, version: 3 } subnet = RouterId { vni: Vni(380956), kind: System }
26812025-01-09T02:06:34.240ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26822025-01-09T02:06:34.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64839 req_id = e3cf9b23-73b8-48e2-be7c-5f8d050e3c3a response_code = 200 uri = /network-bootstore-config
26832025-01-09T02:06:34.244ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3838 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44431 req_id = 2582f5ce-f67e-4394-a53a-adcc42e886e7 response_code = 204 uri = /vpc-routes
26842025-01-09T02:06:34.276ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26852025-01-09T02:06:34.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 98144 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50856 req_id = 6d780b18-e0ac-4c32-9cbd-bdc71b541dcd response_code = 204 uri = /switch-ports
26862025-01-09T02:06:34.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50856 req_id = f4b3865a-6933-4744-8c5f-2f3cca4bef09 response_code = 200 uri = /network-bootstore-config
26872025-01-09T02:06:34.552ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc") failed: Property not found. retry in 1.346745718s file = illumos-utils/src/svc.rs:36 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc zone = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
26882025-01-09T02:06:35.153ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57820
26892025-01-09T02:06:35.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58241
26902025-01-09T02:06:35.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58241 req_id = fd1e8c73-94c9-4351-be78-86836c2b72d1 response_code = 200 uri = /v2p
26912025-01-09T02:06:35.381ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50244
26922025-01-09T02:06:35.381ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4145
26932025-01-09T02:06:35.418ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4169
26942025-01-09T02:06:35.477ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 96040 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:50244 req_id = e9b0fa09-f083-4920-925d-d6af6b4ca9d0 response_code = 204 uri = /switch-ports
26952025-01-09T02:06:35.478ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50244 req_id = 7583ce7f-1b53-4c53-a0fe-445d9b6be7bc response_code = 200 uri = /network-bootstore-config
26962025-01-09T02:06:35.911ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc") failed: Property not found. retry in 1.218255172s file = illumos-utils/src/svc.rs:36 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc zone = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
26972025-01-09T02:06:37.161ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc file = sled-agent/src/instance.rs:2067 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
26982025-01-09T02:06:37.171ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc") failed: Property not found. retry in 68.439141ms file = illumos-utils/src/svc.rs:36 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
26992025-01-09T02:06:37.254ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2076 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27002025-01-09T02:06:37.293ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2100 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27012025-01-09T02:06:37.434ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1213 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27022025-01-09T02:06:37.435ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-09T02:06:37.435111972Z } file = sled-agent/src/instance.rs:780 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27032025-01-09T02:06:37.435ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-09T02:06:37.435111972Z } propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27042025-01-09T02:06:37.435ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-09T02:06:37.435111972Z }, migration_in: None, migration_out: None }
27052025-01-09T02:06:37.435ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
27062025-01-09T02:06:37.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7669052 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38042 req_id = 6bb60a76-0b1b-4f9a-8b5a-7b79591b690d response_code = 204 uri = /eip-gateways
27072025-01-09T02:06:37.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2321118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57820 req_id = 22b215b8-3b69-4ff4-8b81-576f4e5e5be5 response_code = 200 uri = /vmms/467f52d1-1a36-4090-b3eb-c882200620bc/state
27082025-01-09T02:06:37.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3617643 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50635 req_id = 700e58b7-93f7-40c8-89b5-d128a80f4e35 response_code = 200 uri = /vmms/467f52d1-1a36-4090-b3eb-c882200620bc/state
27092025-01-09T02:06:37.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3573669 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54566 req_id = ab0ed14a-7177-430d-8b67-f0e248b040d8 response_code = 200 uri = /vmms/467f52d1-1a36-4090-b3eb-c882200620bc/state
27102025-01-09T02:06:37.474ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-09T02:06:37.474942740Z } file = sled-agent/src/instance.rs:780 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27112025-01-09T02:06:37.474ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-09T02:06:37.474942740Z } propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27122025-01-09T02:06:37.474ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-09T02:06:37.474942740Z }, migration_in: None, migration_out: None }
27132025-01-09T02:06:37.553ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: e4377979-e688-4cfc-9c46-df1d7adb7d95, version: 3 } old_vers = RouterVersion { router_id: e4377979-e688-4cfc-9c46-df1d7adb7d95, version: 3 } subnet = RouterId { vni: Vni(380956), kind: System }
27142025-01-09T02:06:37.553ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 370 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38042 req_id = 3e0b430d-5783-4c4c-9281-fce613ffa904 response_code = 204 uri = /vpc-routes
27152025-01-09T02:06:37.644ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39260
27162025-01-09T02:06:37.644ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39260 req_id = 23b67963-5828-4dad-a47a-9b73ed1a3868 response_code = 200 uri = /vpc-routes
27172025-01-09T02:06:37.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {eeab26b9-6b60-47d9-a432-ee824d0cce75: {10.151.2.176: {0f7ab0d9-8981-463e-b236-8f6e76c19564}, 10.151.2.175: {0f7ab0d9-8981-463e-b236-8f6e76c19564}}} }
27182025-01-09T02:06:37.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39260 req_id = ebd3711c-cbfd-40dc-b842-8dd366e36d88 response_code = 204 uri = /eip-gateways
27192025-01-09T02:06:37.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39260 req_id = b0f327ea-28c6-4999-be00-31c6bcdc9dd0 response_code = 204 uri = /vpc-routes
27202025-01-09T02:06:47.463ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56679
27212025-01-09T02:06:47.463ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 515 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:56679 req_id = 71f2486c-e49f-440a-85f3-9538e2f6f821 response_code = 200 uri = /vmms/467f52d1-1a36-4090-b3eb-c882200620bc/state
27222025-01-09T02:06:47.463ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-09T02:06:47.463954434Z } file = sled-agent/src/instance.rs:780 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27232025-01-09T02:06:47.463ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-09T02:06:47.463954434Z } propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27242025-01-09T02:06:47.463ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-09T02:06:47.463954434Z }, migration_in: None, migration_out: None }
27252025-01-09T02:06:47.483ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-09T02:06:47.483667895Z } file = sled-agent/src/instance.rs:780 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27262025-01-09T02:06:47.483ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:802 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-09T02:06:47.483667895Z } propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27272025-01-09T02:06:47.483ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:816 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27282025-01-09T02:06:47.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27292025-01-09T02:06:47.483ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27302025-01-09T02:06:47.484ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 11213363256352220035 n_samples = 6 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
27312025-01-09T02:06:47.484ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 9367786818285866378 n_samples = 6 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
27322025-01-09T02:06:47.484ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/6b05c0a2-19ba-4ee9-bcb9-fc568a354b1e/debug/bundle/zone", "/pool/int/ead9d093-2dbf-48c5-ad15-3f99074b7078/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/2414008d-221a-4a74-800b-eda0a3acdf4d/crypt/debug", "/pool/ext/2ab41312-6b08-4bf8-a0ad-e5e4e28f9247/crypt/debug", "/pool/ext/6f3f94ab-1776-457a-b887-7085a2c11828/crypt/debug", "/pool/ext/d4cb66ec-6ed9-4ece-810f-eb6a814417d8/crypt/debug", "/pool/ext/e3b35f00-104f-4cfc-b343-844e77de82c6/crypt/debug", "/pool/ext/cd8783d0-a9a7-460f-ad3b-9c299005a963/crypt/debug", "/pool/ext/9bcb5ffb-3c70-4a59-b16f-35f7144cb14c/crypt/debug", "/pool/ext/de68b76d-2647-4c21-9b4f-742a80c76ec3/crypt/debug", "/pool/ext/b22ab4ae-5a19-4667-afb0-e2711a470b13/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc
27332025-01-09T02:06:47.688ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7432 local_addr = [fd00:1122:3344:101::1]:49866 method = GET remote_addr = [fd00:1122:3344:101::d]:41409 req_id = 0f5d46b9-e33e-41d9-acc5-3401e433129a response_code = 200 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd uri = /e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
27342025-01-09T02:06:48.123ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc", bundle_id: 6a2aff74-7e74-4687-ba54-266dd36d0783 }, time_created: 2025-01-09T02:06:47.485109217Z, version: 0, cause: TerminatedInstance }
27352025-01-09T02:06:48.123ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_467f52d1-1a36-4090-b3eb-c882200620bc file = sled-agent/src/instance.rs:1313 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27362025-01-09T02:06:49.866ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27372025-01-09T02:06:49.882ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(380956), kind: System }
27382025-01-09T02:06:49.882ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(380956), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27392025-01-09T02:06:49.883ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T02:06:49.883192980Z }, migration_in: None, migration_out: None }
27402025-01-09T02:06:49.938ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-09T02:06:49.883192980Z }, migration_in: None, migration_out: None }
27412025-01-09T02:06:49.943ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1250 instance_id = f8f78731-17c8-42ec-be95-8f09a36ed5e5 propolis_id = 467f52d1-1a36-4090-b3eb-c882200620bc
27422025-01-09T02:06:50.074ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52458
27432025-01-09T02:06:50.074ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 28 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52458 req_id = 45b2fde1-54a0-4cc4-abea-59d2861850c5 response_code = 200 uri = /baseboard
27442025-01-09T02:06:50.305ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65130
27452025-01-09T02:06:50.305ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65130 req_id = 5fd05851-932e-4fad-add2-c06cfc7a8709 response_code = 200 uri = /vpc-routes
27462025-01-09T02:06:50.350ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {eeab26b9-6b60-47d9-a432-ee824d0cce75: {10.151.2.176: {0f7ab0d9-8981-463e-b236-8f6e76c19564}, 10.151.2.175: {0f7ab0d9-8981-463e-b236-8f6e76c19564}}} }
27472025-01-09T02:06:50.350ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 753 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65130 req_id = 8c7ea023-74b5-4e14-9e5e-446827abb919 response_code = 204 uri = /eip-gateways
27482025-01-09T02:06:50.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65130 req_id = bf1c0ca0-cf12-4ec6-9210-2ac15439eaf6 response_code = 204 uri = /vpc-routes
27492025-01-09T02:06:50.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36231
27502025-01-09T02:06:50.527ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36231 req_id = fd2522da-6bd2-48b5-8c94-1c9ae864e584 response_code = 200 uri = /v2p
27512025-01-09T02:06:50.823ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61614
27522025-01-09T02:06:50.823ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61614 req_id = a539e6e3-6dc6-4cb3-b5ea-ca20f684fd89 response_code = 200 uri = /v2p
27532025-01-09T02:06:50.989ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41775
27542025-01-09T02:06:50.989ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41775 req_id = 8a797df3-cc7f-4486-989d-5dbd715f29be response_code = 200 uri = /vpc-routes
27552025-01-09T02:06:51.016ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
27562025-01-09T02:06:51.016ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1249 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd
27572025-01-09T02:06:51.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41775 req_id = 40e92cc3-cba2-4089-aec5-40a312b729ab response_code = 204 uri = /eip-gateways
27582025-01-09T02:06:51.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 426 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41775 req_id = 6ab347e8-c26a-4177-8ac3-bd804601575a response_code = 204 uri = /vpc-routes
27592025-01-09T02:06:51.589ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61448
27602025-01-09T02:06:51.589ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61448 req_id = 4fb476f6-f799-4d30-a759-7eed5a1a2d1f response_code = 200 uri = /vpc-routes
27612025-01-09T02:06:51.603ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1223 sled_id = e6fecef6-14a9-49d3-a8bb-39ae9e1483bd values = ExternalIpGatewayMap { mappings: {} }
27622025-01-09T02:06:51.603ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 60 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61448 req_id = 593f44e5-4287-4d2f-a996-c490f50591e9 response_code = 204 uri = /eip-gateways
27632025-01-09T02:06:51.611ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 312 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61448 req_id = 03ed404f-0610-45c8-ad56-49a46c052ae0 response_code = 204 uri = /vpc-routes