Max level shown:
1 [ Jan 22 09:19:31 Enabled. ]
2 [ Jan 22 09:19:31 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 22 09:19:31 Method "start" exited with status 0. ]
4 [ Jan 22 09:19:31 Rereading configuration. ]
5 [ Jan 22 09:19:31 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-22T09:19:31.762ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-22T09:19:31.762ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-22T09:19:31.814ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-22T09:19:31.814ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-22T09:19:31.927ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-22T09:19:31.936ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-22T09:19:31.944ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-22T09:19:32.548ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-22T09:19:32.688ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-22T09:19:32.688ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-22T09:19:32.689ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-22T09:19:32.689ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-22T09:19:32.689ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
202025-01-22T09:19:32.689ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
212025-01-22T09:19:32.692ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-22T09:19:32.692ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-22T09:19:32.692ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-22T09:19:32.692ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-22T09:19:32.692ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-22T09:19:32.692ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-22T09:19:32.692ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-22T09:19:32.692ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-22T09:19:32.692ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-22T09:19:32.704ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-22T09:19:32.704ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 42d2a693-a856-441a-b467-e7857d30832a (zpool)
322025-01-22T09:19:32.800ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal }
332025-01-22T09:19:33.167ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-22T09:19:33.167ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-22T09:19:33.167ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-22T09:19:33.167ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-22T09:19:33.167ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-22T09:19:33.167ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-22T09:19:33.167ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-22T09:19:33.176ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-22T09:19:33.176ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = bc204009-2b70-4bf6-9876-723a32c6c100 (zpool)
422025-01-22T09:19:33.266ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal }
432025-01-22T09:19:33.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-22T09:19:33.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
472025-01-22T09:19:33.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
482025-01-22T09:19:33.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-22T09:19:33.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
502025-01-22T09:19:33.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
512025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-22T09:19:33.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-22T09:19:33.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-22T09:19:33.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-22T09:19:33.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-22T09:19:33.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
582025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
592025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
602025-01-22T09:19:33.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-22T09:19:33.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-22T09:19:33.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632025-01-22T09:19:33.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642025-01-22T09:19:33.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672025-01-22T09:19:33.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-22T09:19:33.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
692025-01-22T09:19:33.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
702025-01-22T09:19:33.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
712025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732025-01-22T09:19:33.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-22T09:19:33.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-22T09:19:33.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-22T09:19:33.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-22T09:19:33.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-22T09:19:33.626ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-22T09:19:33.626ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-22T09:19:33.626ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-22T09:19:33.626ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-22T09:19:33.626ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-22T09:19:33.627ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-22T09:19:33.627ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-22T09:19:33.627ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
892025-01-22T09:19:33.627ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
902025-01-22T09:19:33.627ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
912025-01-22T09:19:33.627ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
922025-01-22T09:19:33.627ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
932025-01-22T09:19:33.627ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
942025-01-22T09:19:33.627ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
952025-01-22T09:19:33.627ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
962025-01-22T09:19:33.627ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
972025-01-22T09:19:33.627ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
982025-01-22T09:19:33.627ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
992025-01-22T09:19:33.627ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1002025-01-22T09:19:33.627ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1012025-01-22T09:19:33.627ZINFOSledAgent (bootstore): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1022025-01-22T09:19:33.627ZINFOSledAgent (bootstore): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1032025-01-22T09:19:33.627ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1042025-01-22T09:19:33.627ZINFOSledAgent (bootstore): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-22T09:19:33.627ZINFOSledAgent (bootstore): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-22T09:19:33.627ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1072025-01-22T09:19:33.627ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1082025-01-22T09:19:33.627ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1092025-01-22T09:19:33.637ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1102025-01-22T09:19:33.637ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 12940, tv_nsec: 655743330 } time_to_next_cleanup = 599.999940359s
1112025-01-22T09:19:33.637ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1122025-01-22T09:19:33.637ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1132025-01-22T09:19:33.640ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/sled-agent-request.json file = common/src/ledger.rs:188
1142025-01-22T09:19:33.641ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/sled-agent-request.json file = common/src/ledger.rs:188
1152025-01-22T09:19:33.641ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1162025-01-22T09:19:33.643ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1172025-01-22T09:19:33.643ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1182025-01-22T09:19:33.643ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1192025-01-22T09:19:33.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1202025-01-22T09:19:33.643ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1212025-01-22T09:19:33.643ZINFOSledAgent (RSS): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/rss-started.marker file = common/src/ledger.rs:188
1222025-01-22T09:19:33.643ZINFOSledAgent (RSS): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/rss-started.marker file = common/src/ledger.rs:188
1232025-01-22T09:19:33.643ZINFOSledAgent (RSS): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1242025-01-22T09:19:33.643ZINFOSledAgent (RSS): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1252025-01-22T09:19:33.643ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1262025-01-22T09:19:33.643ZINFOSledAgent (RSS): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1272025-01-22T09:19:33.644ZINFOSledAgent (RSS): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1282025-01-22T09:19:33.644ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1292025-01-22T09:19:33.644ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1302025-01-22T09:19:33.644ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1312025-01-22T09:19:33.644ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1322025-01-22T09:19:33.644ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1332025-01-22T09:19:33.644ZINFOSledAgent (bootstore): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1342025-01-22T09:19:33.644ZINFOSledAgent (bootstore): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1352025-01-22T09:19:33.644ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1362025-01-22T09:19:33.644ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 (sled), rack_id: fceadc01-7eef-448b-b630-a0fcde156219, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1372025-01-22T09:19:33.645ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1382025-01-22T09:19:33.645ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1392025-01-22T09:19:33.649ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1402025-01-22T09:19:33.656ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1412025-01-22T09:19:33.656ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1422025-01-22T09:19:33.660ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1432025-01-22T09:19:33.660ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1442025-01-22T09:19:33.660ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:62846
1452025-01-22T09:19:33.660ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 (sled), rack_id: fceadc01-7eef-448b-b630-a0fcde156219, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1462025-01-22T09:19:33.660ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1472025-01-22T09:19:33.660ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1482025-01-22T09:19:33.660ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1492025-01-22T09:19:33.660ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1502025-01-22T09:19:33.660ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1512025-01-22T09:19:33.660ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1522025-01-22T09:19:33.660ZINFOSledAgent (StorageManager): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1532025-01-22T09:19:33.660ZINFOSledAgent (StorageManager): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1542025-01-22T09:19:33.660ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1552025-01-22T09:19:33.660ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1562025-01-22T09:19:33.660ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1572025-01-22T09:19:33.660ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1582025-01-22T09:19:33.660ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1592025-01-22T09:19:33.677ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1602025-01-22T09:19:33.698ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1612025-01-22T09:19:33.716ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1622025-01-22T09:19:33.722ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1632025-01-22T09:19:33.722ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1642025-01-22T09:19:33.722ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1652025-01-22T09:19:33.722ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1662025-01-22T09:19:33.725ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 112.550503ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5d013cc1-8e64-4206-a6b8-04812595dcfe", "content-length": "124", "date": "Wed, 22 Jan 2025 09:19:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5d013cc1-8e64-4206-a6b8-04812595dcfe" } file = clients/ddm-admin-client/src/lib.rs:177
1672025-01-22T09:19:33.735ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_42d2a693-a856-441a-b467-e7857d30832a/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1682025-01-22T09:19:33.758ZINFOSledAgent: successfully created encrypted zvol: name="oxi_42d2a693-a856-441a-b467-e7857d30832a/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1692025-01-22T09:19:33.758ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_42d2a693-a856-441a-b467-e7857d30832a/swap" file = sled-agent/src/swap_device.rs:96
1702025-01-22T09:19:33.763ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1712025-01-22T09:19:33.763ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1722025-01-22T09:19:33.763ZINFOSledAgent (BackingFs): Ensuring dataset oxi_42d2a693-a856-441a-b467-e7857d30832a/backing/fmd file = sled-agent/src/backing_fs.rs:139
1732025-01-22T09:19:33.831ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1742025-01-22T09:19:33.839ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1752025-01-22T09:19:33.839ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 165.801071ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "5983708d-3806-4022-92e3-3bb41258d095", "content-length": "124", "date": "Wed, 22 Jan 2025 09:19:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "5983708d-3806-4022-92e3-3bb41258d095" } file = clients/ddm-admin-client/src/lib.rs:177
1762025-01-22T09:19:34.007ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-22T09:19:34.007ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 185.178176ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "30bfc5c4-a426-4067-b772-6674765ea7e3", "content-length": "124", "date": "Wed, 22 Jan 2025 09:19:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "30bfc5c4-a426-4067-b772-6674765ea7e3" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-22T09:19:34.049ZINFOSledAgent (BackingFs): Mounting oxi_42d2a693-a856-441a-b467-e7857d30832a/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1792025-01-22T09:19:34.062ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1802025-01-22T09:19:34.063ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1812025-01-22T09:19:34.063ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1822025-01-22T09:19:34.063ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1832025-01-22T09:19:34.194ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1842025-01-22T09:19:34.194ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 114.641498ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2d317000-1f0b-4c90-a0a7-6ea21cabadaf", "content-length": "124", "date": "Wed, 22 Jan 2025 09:19:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2d317000-1f0b-4c90-a0a7-6ea21cabadaf" } file = clients/ddm-admin-client/src/lib.rs:177
1852025-01-22T09:19:34.311ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1862025-01-22T09:19:34.312ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 143.481238ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "353a6973-a6db-4869-982f-d62a29b2f7b8", "content-length": "124", "date": "Wed, 22 Jan 2025 09:19:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "353a6973-a6db-4869-982f-d62a29b2f7b8" } file = clients/ddm-admin-client/src/lib.rs:177
1872025-01-22T09:19:34.457ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1882025-01-22T09:19:34.457ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 337.062591ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3588bf79-536c-4018-8186-5d09f686047f", "content-length": "124", "date": "Wed, 22 Jan 2025 09:19:33 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3588bf79-536c-4018-8186-5d09f686047f" } file = clients/ddm-admin-client/src/lib.rs:177
1892025-01-22T09:19:34.795ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1902025-01-22T09:19:34.796ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-22T09:19:34.801ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:34317 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1922025-01-22T09:19:34.801ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1932025-01-22T09:19:34.801ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:34317 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1942025-01-22T09:19:34.802ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 145.763788ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1952025-01-22T09:19:34.803ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1962025-01-22T09:19:34.803ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
1972025-01-22T09:19:34.803ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
1982025-01-22T09:19:34.803ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1992025-01-22T09:19:34.950ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 294.49147ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2002025-01-22T09:19:35.246ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.232065042s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2012025-01-22T09:19:36.480ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.330366735s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2022025-01-22T09:19:37.507ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2032025-01-22T09:19:37.507ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2042025-01-22T09:19:37.507ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2052025-01-22T09:19:37.507ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2062025-01-22T09:19:37.507ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2072025-01-22T09:19:37.507ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2082025-01-22T09:19:37.509ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2092025-01-22T09:19:37.511ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2102025-01-22T09:19:37.511ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='5a2431fe-01e6-4e7b-9aef-dec4a2e2e928'/> <propval type="astring" name="rack_id" value='fceadc01-7eef-448b-b630-a0fcde156219'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe9a:2a0e'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='fceadc01-7eef-448b-b630-a0fcde156219'/> <propval type="astring" name="sled_id" value='02eb3679-08e1-4d9d-a221-e5b8fe419fb5'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='02eb3679-08e1-4d9d-a221-e5b8fe419fb5'/> <propval type="astring" name="rack_uuid" value='fceadc01-7eef-448b-b630-a0fcde156219'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='02eb3679-08e1-4d9d-a221-e5b8fe419fb5'/> <propval type="astring" name="rack_uuid" value='fceadc01-7eef-448b-b630-a0fcde156219'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2112025-01-22T09:19:37.511ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2122025-01-22T09:19:37.724ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 73.720145ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2132025-01-22T09:19:37.943ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 88.608785ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2142025-01-22T09:19:37.944ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.013557926s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2152025-01-22T09:19:38.127ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 296.780584ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-01-22T09:19:38.470ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 382.097979ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-01-22T09:19:38.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 565.920251ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-22T09:19:39.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 902.303118ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-22T09:19:39.960ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 4.516139912s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2202025-01-22T09:19:40.685ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 950.552188ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-22T09:19:41.803ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.413170746s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-22T09:19:43.560ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/nexus.rs:527 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2232025-01-22T09:19:43.590ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2242025-01-22T09:19:43.591ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2252025-01-22T09:19:43.592ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2262025-01-22T09:19:43.592ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2272025-01-22T09:19:43.592ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2282025-01-22T09:19:43.592ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2292025-01-22T09:19:43.592ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2302025-01-22T09:19:43.592ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2312025-01-22T09:19:43.592ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2322025-01-22T09:19:43.592ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2332025-01-22T09:19:43.592ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:62846
2342025-01-22T09:19:43.822ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2352025-01-22T09:19:43.823ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2362025-01-22T09:19:43.827ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2372025-01-22T09:19:43.828ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2382025-01-22T09:19:43.828ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2392025-01-22T09:19:44.092ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46736
2402025-01-22T09:19:44.093ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2412025-01-22T09:19:44.093ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2422025-01-22T09:19:44.093ZINFOSledAgent (ServiceManager): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:188
2432025-01-22T09:19:44.093ZINFOSledAgent (ServiceManager): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:188
2442025-01-22T09:19:44.093ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 487 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46736 req_id = 93cc4540-1aca-413d-871d-b1d8c477ce8d response_code = 200 uri = /inventory
2452025-01-22T09:19:44.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:34122
2462025-01-22T09:19:44.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:34122 req_id = e72c5285-fa6c-446c-b9c3-037dcdcf76e5 response_code = 200 uri = /sled-role
2472025-01-22T09:19:44.156ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 369be3b1-72cb-4eae-96ec-02bd79d13e79 (physical_disk), pool_id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 3cd13ade-0044-4a24-a94c-796f6c1ae495 (physical_disk), pool_id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 466d5d5f-793e-421c-aa1e-3fcc91014480 (physical_disk), pool_id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 555fd90d-e622-4f29-85c7-f45ce31980b7 (physical_disk), pool_id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 5d07ab90-04f2-4239-9173-6237ee020fa8 (physical_disk), pool_id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b6a77f68-c45e-41fe-b0f8-791a41227854 (physical_disk), pool_id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c8ad880f-4e00-436e-ae78-f5572d42fea4 (physical_disk), pool_id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ca8c8eed-e05b-415f-bf87-f303543af09e (physical_disk), pool_id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e2e3c309-1712-4455-b28e-911c661b1ccc (physical_disk), pool_id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2482025-01-22T09:19:44.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59939
2492025-01-22T09:19:44.156ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2502025-01-22T09:19:44.156ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 369be3b1-72cb-4eae-96ec-02bd79d13e79 (physical_disk), pool_id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 3cd13ade-0044-4a24-a94c-796f6c1ae495 (physical_disk), pool_id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 466d5d5f-793e-421c-aa1e-3fcc91014480 (physical_disk), pool_id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: 555fd90d-e622-4f29-85c7-f45ce31980b7 (physical_disk), pool_id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 5d07ab90-04f2-4239-9173-6237ee020fa8 (physical_disk), pool_id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: b6a77f68-c45e-41fe-b0f8-791a41227854 (physical_disk), pool_id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: c8ad880f-4e00-436e-ae78-f5572d42fea4 (physical_disk), pool_id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: ca8c8eed-e05b-415f-bf87-f303543af09e (physical_disk), pool_id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: e2e3c309-1712-4455-b28e-911c661b1ccc (physical_disk), pool_id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2512025-01-22T09:19:44.156ZINFOSledAgent (StorageManager): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2522025-01-22T09:19:44.156ZINFOSledAgent (StorageManager): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2532025-01-22T09:19:44.156ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2542025-01-22T09:19:44.156ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2552025-01-22T09:19:44.156ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2562025-01-22T09:19:44.156ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2572025-01-22T09:19:44.156ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2582025-01-22T09:19:44.340ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2592025-01-22T09:19:44.340ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool)
2602025-01-22T09:19:44.592ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 14.336348925s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2612025-01-22T09:19:44.592ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/probe_manager.rs:231 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2622025-01-22T09:19:44.842ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7697435198695744416 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2632025-01-22T09:19:44.842ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5436863415136858457 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2642025-01-22T09:19:45.550ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2652025-01-22T09:19:45.566ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }
2662025-01-22T09:19:45.574ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2672025-01-22T09:19:45.574ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2682025-01-22T09:19:45.574ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2692025-01-22T09:19:45.574ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2702025-01-22T09:19:45.574ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2712025-01-22T09:19:45.574ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722025-01-22T09:19:45.574ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2732025-01-22T09:19:45.594ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/probe_manager.rs:231 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
2742025-01-22T09:19:45.612ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752025-01-22T09:19:45.620ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone file = sled-storage/src/dataset.rs:302
2762025-01-22T09:19:45.760ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b5aeeec4-0c1c-45d8-941a-82b993064243 file = sled-storage/src/dataset.rs:388
2772025-01-22T09:19:45.768ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2782025-01-22T09:19:45.768ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2792025-01-22T09:19:45.768ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2802025-01-22T09:19:45.768ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2812025-01-22T09:19:45.768ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2822025-01-22T09:19:45.778ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2832025-01-22T09:19:45.778ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool)
2842025-01-22T09:19:45.872ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }
2852025-01-22T09:19:45.881ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2862025-01-22T09:19:45.881ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2872025-01-22T09:19:45.881ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2882025-01-22T09:19:45.881ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2892025-01-22T09:19:45.881ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902025-01-22T09:19:45.881ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-01-22T09:19:45.881ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2922025-01-22T09:19:45.915ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2932025-01-22T09:19:45.923ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_34031fe8-4691-4be6-a0d4-bb1591795113/crypt/zone file = sled-storage/src/dataset.rs:302
2942025-01-22T09:19:46.057ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_34031fe8-4691-4be6-a0d4-bb1591795113 file = sled-storage/src/dataset.rs:388
2952025-01-22T09:19:46.064ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2962025-01-22T09:19:46.064ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2972025-01-22T09:19:46.064ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2982025-01-22T09:19:46.064ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2992025-01-22T09:19:46.064ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3002025-01-22T09:19:46.075ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3012025-01-22T09:19:46.075ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool)
3022025-01-22T09:19:46.170ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }
3032025-01-22T09:19:46.178ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3042025-01-22T09:19:46.178ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3052025-01-22T09:19:46.178ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3062025-01-22T09:19:46.179ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3072025-01-22T09:19:46.179ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3082025-01-22T09:19:46.179ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-01-22T09:19:46.179ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3102025-01-22T09:19:46.214ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3112025-01-22T09:19:46.222ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone file = sled-storage/src/dataset.rs:302
3122025-01-22T09:19:46.362ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3 file = sled-storage/src/dataset.rs:388
3132025-01-22T09:19:46.370ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3142025-01-22T09:19:46.370ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3152025-01-22T09:19:46.370ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3162025-01-22T09:19:46.370ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3172025-01-22T09:19:46.370ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3182025-01-22T09:19:46.380ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3192025-01-22T09:19:46.380ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool)
3202025-01-22T09:19:46.474ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }
3212025-01-22T09:19:46.482ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3222025-01-22T09:19:46.482ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3232025-01-22T09:19:46.482ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3242025-01-22T09:19:46.482ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3252025-01-22T09:19:46.482ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3262025-01-22T09:19:46.482ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272025-01-22T09:19:46.482ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3282025-01-22T09:19:46.519ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3292025-01-22T09:19:46.527ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38/crypt/zone file = sled-storage/src/dataset.rs:302
3302025-01-22T09:19:46.599ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/probe_manager.rs:231 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
3312025-01-22T09:19:46.666ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38 file = sled-storage/src/dataset.rs:388
3322025-01-22T09:19:46.674ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3332025-01-22T09:19:46.674ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3342025-01-22T09:19:46.674ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3352025-01-22T09:19:46.674ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3362025-01-22T09:19:46.674ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3372025-01-22T09:19:46.684ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3382025-01-22T09:19:46.684ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool)
3392025-01-22T09:19:46.774ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }
3402025-01-22T09:19:46.782ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3412025-01-22T09:19:46.782ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3422025-01-22T09:19:46.782ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3432025-01-22T09:19:46.782ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3442025-01-22T09:19:46.782ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3452025-01-22T09:19:46.783ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-01-22T09:19:46.783ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3472025-01-22T09:19:46.817ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3482025-01-22T09:19:46.824ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750/crypt/zone file = sled-storage/src/dataset.rs:302
3492025-01-22T09:19:46.959ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750 file = sled-storage/src/dataset.rs:388
3502025-01-22T09:19:46.968ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3512025-01-22T09:19:46.968ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3522025-01-22T09:19:46.968ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3532025-01-22T09:19:46.968ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3542025-01-22T09:19:46.968ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3552025-01-22T09:19:46.978ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3562025-01-22T09:19:46.978ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = bbff868b-4199-4969-b27b-36834c92fe00 (zpool)
3572025-01-22T09:19:47.077ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }
3582025-01-22T09:19:47.085ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3592025-01-22T09:19:47.085ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3602025-01-22T09:19:47.085ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3612025-01-22T09:19:47.085ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3622025-01-22T09:19:47.085ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3632025-01-22T09:19:47.085ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-01-22T09:19:47.085ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3652025-01-22T09:19:47.121ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3662025-01-22T09:19:47.129ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone file = sled-storage/src/dataset.rs:302
3672025-01-22T09:19:47.272ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_bbff868b-4199-4969-b27b-36834c92fe00 file = sled-storage/src/dataset.rs:388
3682025-01-22T09:19:47.281ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3692025-01-22T09:19:47.281ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3702025-01-22T09:19:47.281ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3712025-01-22T09:19:47.281ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3722025-01-22T09:19:47.281ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3732025-01-22T09:19:47.291ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3742025-01-22T09:19:47.291ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool)
3752025-01-22T09:19:47.390ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }
3762025-01-22T09:19:47.398ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3772025-01-22T09:19:47.398ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3782025-01-22T09:19:47.398ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3792025-01-22T09:19:47.398ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3802025-01-22T09:19:47.398ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3812025-01-22T09:19:47.398ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-01-22T09:19:47.398ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3832025-01-22T09:19:47.434ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3842025-01-22T09:19:47.441ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8/crypt/zone file = sled-storage/src/dataset.rs:302
3852025-01-22T09:19:47.581ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8 file = sled-storage/src/dataset.rs:388
3862025-01-22T09:19:47.590ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3872025-01-22T09:19:47.590ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3882025-01-22T09:19:47.590ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3892025-01-22T09:19:47.590ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3902025-01-22T09:19:47.590ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3912025-01-22T09:19:47.600ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3922025-01-22T09:19:47.600ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool)
3932025-01-22T09:19:47.697ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }
3942025-01-22T09:19:47.705ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3952025-01-22T09:19:47.705ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3962025-01-22T09:19:47.705ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3972025-01-22T09:19:47.705ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3982025-01-22T09:19:47.705ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
3992025-01-22T09:19:47.705ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4002025-01-22T09:19:47.705ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4012025-01-22T09:19:47.710ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/probe_manager.rs:231 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4022025-01-22T09:19:47.750ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4032025-01-22T09:19:47.759ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/zone file = sled-storage/src/dataset.rs:302
4042025-01-22T09:19:47.901ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 file = sled-storage/src/dataset.rs:388
4052025-01-22T09:19:47.909ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4062025-01-22T09:19:47.909ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4072025-01-22T09:19:47.909ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4082025-01-22T09:19:47.909ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4092025-01-22T09:19:47.909ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4102025-01-22T09:19:47.919ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4112025-01-22T09:19:47.919ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = dad37219-37a0-41c1-b1d5-db92f039358b (zpool)
4122025-01-22T09:19:48.017ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }
4132025-01-22T09:19:48.024ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4142025-01-22T09:19:48.024ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4152025-01-22T09:19:48.024ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4162025-01-22T09:19:48.024ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4172025-01-22T09:19:48.024ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4182025-01-22T09:19:48.024ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-01-22T09:19:48.024ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4202025-01-22T09:19:48.063ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4212025-01-22T09:19:48.072ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone file = sled-storage/src/dataset.rs:302
4222025-01-22T09:19:48.209ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_dad37219-37a0-41c1-b1d5-db92f039358b file = sled-storage/src/dataset.rs:388
4232025-01-22T09:19:48.216ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4242025-01-22T09:19:48.216ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4252025-01-22T09:19:48.217ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4262025-01-22T09:19:48.217ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42d2a693-a856-441a-b467-e7857d30832a (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bc204009-2b70-4bf6-9876-723a32c6c100 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4272025-01-22T09:19:48.217ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4282025-01-22T09:19:48.217ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4292025-01-22T09:19:48.217ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4302025-01-22T09:19:48.217ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4312025-01-22T09:19:48.217ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4322025-01-22T09:19:48.217ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4332025-01-22T09:19:48.217ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4342025-01-22T09:19:48.217ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4352025-01-22T09:19:48.217ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4362025-01-22T09:19:48.217ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4372025-01-22T09:19:48.217ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4382025-01-22T09:19:48.217ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4392025-01-22T09:19:48.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4061357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59939 req_id = d9e36b2f-7157-4bcc-87dd-145d1dfff038 response_code = 200 uri = /omicron-physical-disks
4402025-01-22T09:19:48.249ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {025ca40c-6903-4553-a83f-49b7d18671cd (dataset): DatasetConfig { id: 025ca40c-6903-4553-a83f-49b7d18671cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 032ce160-e3cf-4f2e-b934-8a89b6454d46 (dataset): DatasetConfig { id: 032ce160-e3cf-4f2e-b934-8a89b6454d46 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08f66876-0636-4c93-9df1-60cf68511f6d (dataset): DatasetConfig { id: 08f66876-0636-4c93-9df1-60cf68511f6d (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b33ddf4-3b15-48d9-baa0-d758030634e6 (dataset): DatasetConfig { id: 0b33ddf4-3b15-48d9-baa0-d758030634e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f983101-feb1-477c-aec3-7eb508a961e6 (dataset): DatasetConfig { id: 0f983101-feb1-477c-aec3-7eb508a961e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10579cfb-26a4-46ed-9b20-886260835e5d (dataset): DatasetConfig { id: 10579cfb-26a4-46ed-9b20-886260835e5d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10a7dc87-a070-4c09-a7f9-921a833cca03 (dataset): DatasetConfig { id: 10a7dc87-a070-4c09-a7f9-921a833cca03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d313403-04e5-42ba-830f-69162af01437" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18484e59-06b5-4582-9df0-d7cbaf421d0d (dataset): DatasetConfig { id: 18484e59-06b5-4582-9df0-d7cbaf421d0d (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a4244c5-300a-4f9a-9c8b-879b574891d0 (dataset): DatasetConfig { id: 1a4244c5-300a-4f9a-9c8b-879b574891d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1bdd790c-b7b8-4305-aa61-bca606e65db9 (dataset): DatasetConfig { id: 1bdd790c-b7b8-4305-aa61-bca606e65db9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c43a89e-6ae7-4e6e-ad42-5e68d5175eff (dataset): DatasetConfig { id: 1c43a89e-6ae7-4e6e-ad42-5e68d5175eff (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f355370f-27f8-480f-a075-c338511729ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e055751-0e9a-429b-946c-96a377a99b4f (dataset): DatasetConfig { id: 1e055751-0e9a-429b-946c-96a377a99b4f (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f3dbd48-7b69-44dd-b2a6-b7a9a0ff1306 (dataset): DatasetConfig { id: 1f3dbd48-7b69-44dd-b2a6-b7a9a0ff1306 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26483bab-b73f-41cc-8c21-a12837175476 (dataset): DatasetConfig { id: 26483bab-b73f-41cc-8c21-a12837175476 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27494b7c-5f6f-4a2b-9b16-cb45f574c4b9 (dataset): DatasetConfig { id: 27494b7c-5f6f-4a2b-9b16-cb45f574c4b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27b300c4-c32a-4b47-8593-077c19fcaec1 (dataset): DatasetConfig { id: 27b300c4-c32a-4b47-8593-077c19fcaec1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27f6e953-e3ec-44a8-9e2d-15a4878125b4 (dataset): DatasetConfig { id: 27f6e953-e3ec-44a8-9e2d-15a4878125b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c3b4f71-e96d-4ffc-a9bc-36226598619f (dataset): DatasetConfig { id: 2c3b4f71-e96d-4ffc-a9bc-36226598619f (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c4c9576-0f57-4187-8b76-202c01291696 (dataset): DatasetConfig { id: 2c4c9576-0f57-4187-8b76-202c01291696 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c685ae3-a439-41a4-a6b2-ecebfc5cef07 (dataset): DatasetConfig { id: 2c685ae3-a439-41a4-a6b2-ecebfc5cef07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32efe7ca-7b37-4e8d-aac2-f6d2c566fccf (dataset): DatasetConfig { id: 32efe7ca-7b37-4e8d-aac2-f6d2c566fccf (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3511d9bd-ef05-4d7f-95a0-ed69a115d812 (dataset): DatasetConfig { id: 3511d9bd-ef05-4d7f-95a0-ed69a115d812 (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35a17db2-cb32-470c-9c20-81295b362dcc (dataset): DatasetConfig { id: 35a17db2-cb32-470c-9c20-81295b362dcc (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 367e7d04-bc2f-491e-8231-5322a06db630 (dataset): DatasetConfig { id: 367e7d04-bc2f-491e-8231-5322a06db630 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c616c7b-4e17-47f0-a780-2a1847a4c87a (dataset): DatasetConfig { id: 3c616c7b-4e17-47f0-a780-2a1847a4c87a (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c749209-8e7d-479d-a522-470fde7301dd (dataset): DatasetConfig { id: 3c749209-8e7d-479d-a522-470fde7301dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 400d3932-b46a-4b55-ac98-4c45c3406ea6 (dataset): DatasetConfig { id: 400d3932-b46a-4b55-ac98-4c45c3406ea6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44ca6201-cdaa-40e3-994b-02dbe798ca33 (dataset): DatasetConfig { id: 44ca6201-cdaa-40e3-994b-02dbe798ca33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f129a86-14a5-471d-bffe-09fc624d28c1 (dataset): DatasetConfig { id: 4f129a86-14a5-471d-bffe-09fc624d28c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53b91a2b-ee01-4910-b066-1c65bdb6bdea (dataset): DatasetConfig { id: 53b91a2b-ee01-4910-b066-1c65bdb6bdea (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b92553b-7ed6-4d04-9467-8f3c5296757c (dataset): DatasetConfig { id: 5b92553b-7ed6-4d04-9467-8f3c5296757c (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c033ba1-8c31-4427-8050-5696e7fcd992 (dataset): DatasetConfig { id: 5c033ba1-8c31-4427-8050-5696e7fcd992 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eff67d6-8514-435c-a8da-1c6a0f846293 (dataset): DatasetConfig { id: 5eff67d6-8514-435c-a8da-1c6a0f846293 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6333c005-c4ae-45e5-b6b1-7356869a3ae6 (dataset): DatasetConfig { id: 6333c005-c4ae-45e5-b6b1-7356869a3ae6 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6551fb3f-5807-413a-a2d0-4004da002d67 (dataset): DatasetConfig { id: 6551fb3f-5807-413a-a2d0-4004da002d67 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 687ba1a5-6331-4fd6-9e84-de79dedaa5dd (dataset): DatasetConfig { id: 687ba1a5-6331-4fd6-9e84-de79dedaa5dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ad2064c-c9e5-4c74-ba60-5613dd7028be (dataset): DatasetConfig { id: 6ad2064c-c9e5-4c74-ba60-5613dd7028be (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d148655-e617-4236-a7fc-2ea796af7411 (dataset): DatasetConfig { id: 6d148655-e617-4236-a7fc-2ea796af7411 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7632adb8-453d-4121-b4ce-938eb306c8ff (dataset): DatasetConfig { id: 7632adb8-453d-4121-b4ce-938eb306c8ff (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7dcffdd3-2095-40a1-a0fb-a0334efb32e2 (dataset): DatasetConfig { id: 7dcffdd3-2095-40a1-a0fb-a0334efb32e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e3a8f73-2fb6-46fa-b6f6-01370073c4a8 (dataset): DatasetConfig { id: 7e3a8f73-2fb6-46fa-b6f6-01370073c4a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7ff09108-da8b-4c11-8e36-89fd887579ca (dataset): DatasetConfig { id: 7ff09108-da8b-4c11-8e36-89fd887579ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82cc4f7f-1c34-4f1c-bb9b-d86e4ee199e6 (dataset): DatasetConfig { id: 82cc4f7f-1c34-4f1c-bb9b-d86e4ee199e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8359dced-49a7-4632-9f77-e5706ef7673e (dataset): DatasetConfig { id: 8359dced-49a7-4632-9f77-e5706ef7673e (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8418ed06-10a5-4335-aace-af875e5cc8a5 (dataset): DatasetConfig { id: 8418ed06-10a5-4335-aace-af875e5cc8a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8474491f-372e-466a-9887-bc0d8c9a25c1 (dataset): DatasetConfig { id: 8474491f-372e-466a-9887-bc0d8c9a25c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 879f327f-9f14-48d5-b060-4adc4c301c1c (dataset): DatasetConfig { id: 879f327f-9f14-48d5-b060-4adc4c301c1c (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8bfab28f-5769-4ad4-ba3d-82ddf3c7330a (dataset): DatasetConfig { id: 8bfab28f-5769-4ad4-ba3d-82ddf3c7330a (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a40fc7c2-0907-41fd-9e48-c5c84e703185 (dataset): DatasetConfig { id: a40fc7c2-0907-41fd-9e48-c5c84e703185 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7d5512b-a6b0-47da-9ea3-525eeba19b8a (dataset): DatasetConfig { id: a7d5512b-a6b0-47da-9ea3-525eeba19b8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab505dda-5374-43eb-a172-086d82951aa8 (dataset): DatasetConfig { id: ab505dda-5374-43eb-a172-086d82951aa8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b014cfe0-26b2-48ef-826b-8382f8330100 (dataset): DatasetConfig { id: b014cfe0-26b2-48ef-826b-8382f8330100 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b67312af-e982-4813-b931-d4d6d5a56c28 (dataset): DatasetConfig { id: b67312af-e982-4813-b931-d4d6d5a56c28 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7a32571-3dc5-4673-ac94-f2a3e7f7c48b (dataset): DatasetConfig { id: b7a32571-3dc5-4673-ac94-f2a3e7f7c48b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b83d4a87-b07e-4ab2-9f8d-66b324b73197 (dataset): DatasetConfig { id: b83d4a87-b07e-4ab2-9f8d-66b324b73197 (dataset), name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ba4b677a-8301-4693-9c77-615bdee08131 (dataset): DatasetConfig { id: ba4b677a-8301-4693-9c77-615bdee08131 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbe23bb4-5171-4310-ae51-79162adda07d (dataset): DatasetConfig { id: bbe23bb4-5171-4310-ae51-79162adda07d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, beed6d8e-03d8-4960-a687-e3f0f3878dfe (dataset): DatasetConfig { id: beed6d8e-03d8-4960-a687-e3f0f3878dfe (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc5dfb52-4315-42c6-8171-c5bc0cb2677f (dataset): DatasetConfig { id: cc5dfb52-4315-42c6-8171-c5bc0cb2677f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cedeb232-36fb-4078-b32d-9ca62749561b (dataset): DatasetConfig { id: cedeb232-36fb-4078-b32d-9ca62749561b (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d011c212-ee61-4e6b-985f-f53eb0600647 (dataset): DatasetConfig { id: d011c212-ee61-4e6b-985f-f53eb0600647 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d0b7f7aa-7583-44e9-a206-7f03994f6819 (dataset): DatasetConfig { id: d0b7f7aa-7583-44e9-a206-7f03994f6819 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddb57062-c442-40f3-b1bb-a3f4eee1f675 (dataset): DatasetConfig { id: ddb57062-c442-40f3-b1bb-a3f4eee1f675 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dec6e71d-2146-4dcc-90a1-6d97fcd0c337 (dataset): DatasetConfig { id: dec6e71d-2146-4dcc-90a1-6d97fcd0c337 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f07266f3-199a-4782-833f-6eeee33dc9f7 (dataset): DatasetConfig { id: f07266f3-199a-4782-833f-6eeee33dc9f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa526a00-be9f-4387-929c-d7bc9d644e63 (dataset): DatasetConfig { id: fa526a00-be9f-4387-929c-d7bc9d644e63 (dataset), name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4412025-01-22T09:19:48.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33861
4422025-01-22T09:19:48.250ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4432025-01-22T09:19:48.250ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {025ca40c-6903-4553-a83f-49b7d18671cd (dataset): DatasetConfig { id: 025ca40c-6903-4553-a83f-49b7d18671cd (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 032ce160-e3cf-4f2e-b934-8a89b6454d46 (dataset): DatasetConfig { id: 032ce160-e3cf-4f2e-b934-8a89b6454d46 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08f66876-0636-4c93-9df1-60cf68511f6d (dataset): DatasetConfig { id: 08f66876-0636-4c93-9df1-60cf68511f6d (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0b33ddf4-3b15-48d9-baa0-d758030634e6 (dataset): DatasetConfig { id: 0b33ddf4-3b15-48d9-baa0-d758030634e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 0f983101-feb1-477c-aec3-7eb508a961e6 (dataset): DatasetConfig { id: 0f983101-feb1-477c-aec3-7eb508a961e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10579cfb-26a4-46ed-9b20-886260835e5d (dataset): DatasetConfig { id: 10579cfb-26a4-46ed-9b20-886260835e5d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 10a7dc87-a070-4c09-a7f9-921a833cca03 (dataset): DatasetConfig { id: 10a7dc87-a070-4c09-a7f9-921a833cca03 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_8d313403-04e5-42ba-830f-69162af01437" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18484e59-06b5-4582-9df0-d7cbaf421d0d (dataset): DatasetConfig { id: 18484e59-06b5-4582-9df0-d7cbaf421d0d (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a4244c5-300a-4f9a-9c8b-879b574891d0 (dataset): DatasetConfig { id: 1a4244c5-300a-4f9a-9c8b-879b574891d0 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1bdd790c-b7b8-4305-aa61-bca606e65db9 (dataset): DatasetConfig { id: 1bdd790c-b7b8-4305-aa61-bca606e65db9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1c43a89e-6ae7-4e6e-ad42-5e68d5175eff (dataset): DatasetConfig { id: 1c43a89e-6ae7-4e6e-ad42-5e68d5175eff (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_f355370f-27f8-480f-a075-c338511729ae" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1e055751-0e9a-429b-946c-96a377a99b4f (dataset): DatasetConfig { id: 1e055751-0e9a-429b-946c-96a377a99b4f (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1f3dbd48-7b69-44dd-b2a6-b7a9a0ff1306 (dataset): DatasetConfig { id: 1f3dbd48-7b69-44dd-b2a6-b7a9a0ff1306 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 26483bab-b73f-41cc-8c21-a12837175476 (dataset): DatasetConfig { id: 26483bab-b73f-41cc-8c21-a12837175476 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27494b7c-5f6f-4a2b-9b16-cb45f574c4b9 (dataset): DatasetConfig { id: 27494b7c-5f6f-4a2b-9b16-cb45f574c4b9 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27b300c4-c32a-4b47-8593-077c19fcaec1 (dataset): DatasetConfig { id: 27b300c4-c32a-4b47-8593-077c19fcaec1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 27f6e953-e3ec-44a8-9e2d-15a4878125b4 (dataset): DatasetConfig { id: 27f6e953-e3ec-44a8-9e2d-15a4878125b4 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c3b4f71-e96d-4ffc-a9bc-36226598619f (dataset): DatasetConfig { id: 2c3b4f71-e96d-4ffc-a9bc-36226598619f (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c4c9576-0f57-4187-8b76-202c01291696 (dataset): DatasetConfig { id: 2c4c9576-0f57-4187-8b76-202c01291696 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2c685ae3-a439-41a4-a6b2-ecebfc5cef07 (dataset): DatasetConfig { id: 2c685ae3-a439-41a4-a6b2-ecebfc5cef07 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 32efe7ca-7b37-4e8d-aac2-f6d2c566fccf (dataset): DatasetConfig { id: 32efe7ca-7b37-4e8d-aac2-f6d2c566fccf (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3511d9bd-ef05-4d7f-95a0-ed69a115d812 (dataset): DatasetConfig { id: 3511d9bd-ef05-4d7f-95a0-ed69a115d812 (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 35a17db2-cb32-470c-9c20-81295b362dcc (dataset): DatasetConfig { id: 35a17db2-cb32-470c-9c20-81295b362dcc (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 367e7d04-bc2f-491e-8231-5322a06db630 (dataset): DatasetConfig { id: 367e7d04-bc2f-491e-8231-5322a06db630 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c616c7b-4e17-47f0-a780-2a1847a4c87a (dataset): DatasetConfig { id: 3c616c7b-4e17-47f0-a780-2a1847a4c87a (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3c749209-8e7d-479d-a522-470fde7301dd (dataset): DatasetConfig { id: 3c749209-8e7d-479d-a522-470fde7301dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 400d3932-b46a-4b55-ac98-4c45c3406ea6 (dataset): DatasetConfig { id: 400d3932-b46a-4b55-ac98-4c45c3406ea6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 44ca6201-cdaa-40e3-994b-02dbe798ca33 (dataset): DatasetConfig { id: 44ca6201-cdaa-40e3-994b-02dbe798ca33 (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 4f129a86-14a5-471d-bffe-09fc624d28c1 (dataset): DatasetConfig { id: 4f129a86-14a5-471d-bffe-09fc624d28c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 53b91a2b-ee01-4910-b066-1c65bdb6bdea (dataset): DatasetConfig { id: 53b91a2b-ee01-4910-b066-1c65bdb6bdea (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5b92553b-7ed6-4d04-9467-8f3c5296757c (dataset): DatasetConfig { id: 5b92553b-7ed6-4d04-9467-8f3c5296757c (dataset), name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5c033ba1-8c31-4427-8050-5696e7fcd992 (dataset): DatasetConfig { id: 5c033ba1-8c31-4427-8050-5696e7fcd992 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5eff67d6-8514-435c-a8da-1c6a0f846293 (dataset): DatasetConfig { id: 5eff67d6-8514-435c-a8da-1c6a0f846293 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6333c005-c4ae-45e5-b6b1-7356869a3ae6 (dataset): DatasetConfig { id: 6333c005-c4ae-45e5-b6b1-7356869a3ae6 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6551fb3f-5807-413a-a2d0-4004da002d67 (dataset): DatasetConfig { id: 6551fb3f-5807-413a-a2d0-4004da002d67 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 687ba1a5-6331-4fd6-9e84-de79dedaa5dd (dataset): DatasetConfig { id: 687ba1a5-6331-4fd6-9e84-de79dedaa5dd (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6ad2064c-c9e5-4c74-ba60-5613dd7028be (dataset): DatasetConfig { id: 6ad2064c-c9e5-4c74-ba60-5613dd7028be (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d148655-e617-4236-a7fc-2ea796af7411 (dataset): DatasetConfig { id: 6d148655-e617-4236-a7fc-2ea796af7411 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7632adb8-453d-4121-b4ce-938eb306c8ff (dataset): DatasetConfig { id: 7632adb8-453d-4121-b4ce-938eb306c8ff (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7dcffdd3-2095-40a1-a0fb-a0334efb32e2 (dataset): DatasetConfig { id: 7dcffdd3-2095-40a1-a0fb-a0334efb32e2 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7e3a8f73-2fb6-46fa-b6f6-01370073c4a8 (dataset): DatasetConfig { id: 7e3a8f73-2fb6-46fa-b6f6-01370073c4a8 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 7ff09108-da8b-4c11-8e36-89fd887579ca (dataset): DatasetConfig { id: 7ff09108-da8b-4c11-8e36-89fd887579ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82cc4f7f-1c34-4f1c-bb9b-d86e4ee199e6 (dataset): DatasetConfig { id: 82cc4f7f-1c34-4f1c-bb9b-d86e4ee199e6 (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8359dced-49a7-4632-9f77-e5706ef7673e (dataset): DatasetConfig { id: 8359dced-49a7-4632-9f77-e5706ef7673e (dataset), name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8418ed06-10a5-4335-aace-af875e5cc8a5 (dataset): DatasetConfig { id: 8418ed06-10a5-4335-aace-af875e5cc8a5 (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8474491f-372e-466a-9887-bc0d8c9a25c1 (dataset): DatasetConfig { id: 8474491f-372e-466a-9887-bc0d8c9a25c1 (dataset), name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 879f327f-9f14-48d5-b060-4adc4c301c1c (dataset): DatasetConfig { id: 879f327f-9f14-48d5-b060-4adc4c301c1c (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8bfab28f-5769-4ad4-ba3d-82ddf3c7330a (dataset): DatasetConfig { id: 8bfab28f-5769-4ad4-ba3d-82ddf3c7330a (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a40fc7c2-0907-41fd-9e48-c5c84e703185 (dataset): DatasetConfig { id: a40fc7c2-0907-41fd-9e48-c5c84e703185 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a7d5512b-a6b0-47da-9ea3-525eeba19b8a (dataset): DatasetConfig { id: a7d5512b-a6b0-47da-9ea3-525eeba19b8a (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ab505dda-5374-43eb-a172-086d82951aa8 (dataset): DatasetConfig { id: ab505dda-5374-43eb-a172-086d82951aa8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b014cfe0-26b2-48ef-826b-8382f8330100 (dataset): DatasetConfig { id: b014cfe0-26b2-48ef-826b-8382f8330100 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, b67312af-e982-4813-b931-d4d6d5a56c28 (dataset): DatasetConfig { id: b67312af-e982-4813-b931-d4d6d5a56c28 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b7a32571-3dc5-4673-ac94-f2a3e7f7c48b (dataset): DatasetConfig { id: b7a32571-3dc5-4673-ac94-f2a3e7f7c48b (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b83d4a87-b07e-4ab2-9f8d-66b324b73197 (dataset): DatasetConfig { id: b83d4a87-b07e-4ab2-9f8d-66b324b73197 (dataset), name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, ba4b677a-8301-4693-9c77-615bdee08131 (dataset): DatasetConfig { id: ba4b677a-8301-4693-9c77-615bdee08131 (dataset), name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bbe23bb4-5171-4310-ae51-79162adda07d (dataset): DatasetConfig { id: bbe23bb4-5171-4310-ae51-79162adda07d (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, beed6d8e-03d8-4960-a687-e3f0f3878dfe (dataset): DatasetConfig { id: beed6d8e-03d8-4960-a687-e3f0f3878dfe (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc5dfb52-4315-42c6-8171-c5bc0cb2677f (dataset): DatasetConfig { id: cc5dfb52-4315-42c6-8171-c5bc0cb2677f (dataset), name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, cedeb232-36fb-4078-b32d-9ca62749561b (dataset): DatasetConfig { id: cedeb232-36fb-4078-b32d-9ca62749561b (dataset), name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d011c212-ee61-4e6b-985f-f53eb0600647 (dataset): DatasetConfig { id: d011c212-ee61-4e6b-985f-f53eb0600647 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, d0b7f7aa-7583-44e9-a206-7f03994f6819 (dataset): DatasetConfig { id: d0b7f7aa-7583-44e9-a206-7f03994f6819 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ddb57062-c442-40f3-b1bb-a3f4eee1f675 (dataset): DatasetConfig { id: ddb57062-c442-40f3-b1bb-a3f4eee1f675 (dataset), name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, dec6e71d-2146-4dcc-90a1-6d97fcd0c337 (dataset): DatasetConfig { id: dec6e71d-2146-4dcc-90a1-6d97fcd0c337 (dataset), name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f07266f3-199a-4782-833f-6eeee33dc9f7 (dataset): DatasetConfig { id: f07266f3-199a-4782-833f-6eeee33dc9f7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fa526a00-be9f-4387-929c-d7bc9d644e63 (dataset): DatasetConfig { id: fa526a00-be9f-4387-929c-d7bc9d644e63 (dataset), name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4442025-01-22T09:19:48.250ZINFOSledAgent (StorageManager): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4452025-01-22T09:19:48.250ZINFOSledAgent (StorageManager): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462025-01-22T09:19:48.250ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4472025-01-22T09:19:48.264ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4482025-01-22T09:19:48.264ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4492025-01-22T09:19:48.264ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4502025-01-22T09:19:48.312ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4512025-01-22T09:19:48.312ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4522025-01-22T09:19:48.312ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d" } file = sled-storage/src/manager.rs:1431
4532025-01-22T09:19:48.372ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4542025-01-22T09:19:48.372ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4552025-01-22T09:19:48.372ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone" } file = sled-storage/src/manager.rs:1431
4562025-01-22T09:19:48.401ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4572025-01-22T09:19:48.401ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4582025-01-22T09:19:48.401ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa" } file = sled-storage/src/manager.rs:1431
4592025-01-22T09:19:48.460ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4602025-01-22T09:19:48.460ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4612025-01-22T09:19:48.460ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/zone/oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e"), full_name: "oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/zone/oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e" } file = sled-storage/src/manager.rs:1431
4622025-01-22T09:19:48.517ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4632025-01-22T09:19:48.517ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4642025-01-22T09:19:48.517ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750/crucible" } file = sled-storage/src/manager.rs:1431
4652025-01-22T09:19:48.564ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4662025-01-22T09:19:48.564ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4672025-01-22T09:19:48.564ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2be08399-4b95-4cf8-9177-fa1c2f515fe8/crypt/zone/oxz_crucible_8d313403-04e5-42ba-830f-69162af01437"), full_name: "oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8/crypt/zone/oxz_crucible_8d313403-04e5-42ba-830f-69162af01437" } file = sled-storage/src/manager.rs:1431
4682025-01-22T09:19:48.623ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4692025-01-22T09:19:48.623ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4702025-01-22T09:19:48.623ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
4712025-01-22T09:19:48.673ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4722025-01-22T09:19:48.673ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4732025-01-22T09:19:48.673ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone"), full_name: "oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone" } file = sled-storage/src/manager.rs:1431
4742025-01-22T09:19:48.701ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4752025-01-22T09:19:48.701ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4762025-01-22T09:19:48.701ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4091af72-7d1b-4529-85f2-2ca5bec8f750/crypt/zone/oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb"), full_name: "oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750/crypt/zone/oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb" } file = sled-storage/src/manager.rs:1431
4772025-01-22T09:19:48.711ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/probe_manager.rs:231 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
4782025-01-22T09:19:48.759ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792025-01-22T09:19:48.759ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4802025-01-22T09:19:48.759ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_nexus_f355370f-27f8-480f-a075-c338511729ae"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_nexus_f355370f-27f8-480f-a075-c338511729ae" } file = sled-storage/src/manager.rs:1431
4812025-01-22T09:19:48.820ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822025-01-22T09:19:48.820ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832025-01-22T09:19:48.820ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30" } file = sled-storage/src/manager.rs:1431
4842025-01-22T09:19:48.878ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852025-01-22T09:19:48.878ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4862025-01-22T09:19:48.878ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4091af72-7d1b-4529-85f2-2ca5bec8f750/crypt/debug"), full_name: "oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750/crypt/debug" } file = sled-storage/src/manager.rs:1431
4872025-01-22T09:19:48.908ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882025-01-22T09:19:48.908ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4892025-01-22T09:19:48.908ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
4902025-01-22T09:19:48.955ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912025-01-22T09:19:48.955ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4922025-01-22T09:19:48.955ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crucible" } file = sled-storage/src/manager.rs:1431
4932025-01-22T09:19:49.002ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942025-01-22T09:19:49.002ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4952025-01-22T09:19:49.002ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone/oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd"), full_name: "oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone/oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd" } file = sled-storage/src/manager.rs:1431
4962025-01-22T09:19:49.058ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972025-01-22T09:19:49.058ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4982025-01-22T09:19:49.058ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4992025-01-22T09:19:49.106ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5002025-01-22T09:19:49.106ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5012025-01-22T09:19:49.106ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb" } file = sled-storage/src/manager.rs:1431
5022025-01-22T09:19:49.164ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5032025-01-22T09:19:49.164ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5042025-01-22T09:19:49.164ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5052025-01-22T09:19:49.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5062025-01-22T09:19:49.212ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5072025-01-22T09:19:49.212ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5082025-01-22T09:19:49.261ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5092025-01-22T09:19:49.261ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5102025-01-22T09:19:49.261ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a" } file = sled-storage/src/manager.rs:1431
5112025-01-22T09:19:49.325ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5122025-01-22T09:19:49.325ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5132025-01-22T09:19:49.325ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/34031fe8-4691-4be6-a0d4-bb1591795113/crypt/zone/oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a"), full_name: "oxp_34031fe8-4691-4be6-a0d4-bb1591795113/crypt/zone/oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a" } file = sled-storage/src/manager.rs:1431
5142025-01-22T09:19:49.385ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5152025-01-22T09:19:49.385ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5162025-01-22T09:19:49.385ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/debug"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/debug" } file = sled-storage/src/manager.rs:1431
5172025-01-22T09:19:49.416ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5182025-01-22T09:19:49.416ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5192025-01-22T09:19:49.416ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/zone/oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0"), full_name: "oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/zone/oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0" } file = sled-storage/src/manager.rs:1431
5202025-01-22T09:19:49.474ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5212025-01-22T09:19:49.474ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5222025-01-22T09:19:49.474ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/34031fe8-4691-4be6-a0d4-bb1591795113/crypt/zone"), full_name: "oxp_34031fe8-4691-4be6-a0d4-bb1591795113/crypt/zone" } file = sled-storage/src/manager.rs:1431
5232025-01-22T09:19:49.502ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5242025-01-22T09:19:49.502ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5252025-01-22T09:19:49.502ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_34031fe8-4691-4be6-a0d4-bb1591795113/crucible" } file = sled-storage/src/manager.rs:1431
5262025-01-22T09:19:49.549ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5272025-01-22T09:19:49.549ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5282025-01-22T09:19:49.550ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crucible" } file = sled-storage/src/manager.rs:1431
5292025-01-22T09:19:49.597ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5302025-01-22T09:19:49.597ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5312025-01-22T09:19:49.597ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/34031fe8-4691-4be6-a0d4-bb1591795113/crypt/debug"), full_name: "oxp_34031fe8-4691-4be6-a0d4-bb1591795113/crypt/debug" } file = sled-storage/src/manager.rs:1431
5322025-01-22T09:19:49.625ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5332025-01-22T09:19:49.625ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5342025-01-22T09:19:49.625ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b03e8f4b-60f0-4c52-958e-2f9571749b38/crypt/zone"), full_name: "oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38/crypt/zone" } file = sled-storage/src/manager.rs:1431
5352025-01-22T09:19:49.653ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5362025-01-22T09:19:49.653ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5372025-01-22T09:19:49.653ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone" } file = sled-storage/src/manager.rs:1431
5382025-01-22T09:19:49.682ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5392025-01-22T09:19:49.682ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5402025-01-22T09:19:49.682ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/34031fe8-4691-4be6-a0d4-bb1591795113/crypt/zone/oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965"), full_name: "oxp_34031fe8-4691-4be6-a0d4-bb1591795113/crypt/zone/oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965" } file = sled-storage/src/manager.rs:1431
5412025-01-22T09:19:49.717ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/probe_manager.rs:231 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
5422025-01-22T09:19:49.742ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5432025-01-22T09:19:49.742ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5442025-01-22T09:19:49.742ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630" } file = sled-storage/src/manager.rs:1431
5452025-01-22T09:19:49.800ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5462025-01-22T09:19:49.800ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5472025-01-22T09:19:49.800ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2be08399-4b95-4cf8-9177-fa1c2f515fe8/crypt/zone"), full_name: "oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8/crypt/zone" } file = sled-storage/src/manager.rs:1431
5482025-01-22T09:19:49.829ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492025-01-22T09:19:49.829ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5502025-01-22T09:19:49.829ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77" } file = sled-storage/src/manager.rs:1431
5512025-01-22T09:19:49.888ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522025-01-22T09:19:49.888ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5532025-01-22T09:19:49.888ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone/oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), full_name: "oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone/oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df" } file = sled-storage/src/manager.rs:1431
5542025-01-22T09:19:49.947ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552025-01-22T09:19:49.947ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562025-01-22T09:19:49.947ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77" } file = sled-storage/src/manager.rs:1431
5572025-01-22T09:19:50.009ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582025-01-22T09:19:50.009ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5592025-01-22T09:19:50.009ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crucible" } file = sled-storage/src/manager.rs:1431
5602025-01-22T09:19:50.060ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612025-01-22T09:19:50.060ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5622025-01-22T09:19:50.060ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/debug"), full_name: "oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/debug" } file = sled-storage/src/manager.rs:1431
5632025-01-22T09:19:50.090ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5642025-01-22T09:19:50.090ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5652025-01-22T09:19:50.090ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad" } file = sled-storage/src/manager.rs:1431
5662025-01-22T09:19:50.152ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5672025-01-22T09:19:50.152ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5682025-01-22T09:19:50.152ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/zone/oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e" } file = sled-storage/src/manager.rs:1431
5692025-01-22T09:19:50.212ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5702025-01-22T09:19:50.212ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5712025-01-22T09:19:50.212ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/bbff868b-4199-4969-b27b-36834c92fe00/crypt/debug"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/debug" } file = sled-storage/src/manager.rs:1431
5722025-01-22T09:19:50.241ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5732025-01-22T09:19:50.241ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5742025-01-22T09:19:50.241ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5752025-01-22T09:19:50.289ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5762025-01-22T09:19:50.289ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5772025-01-22T09:19:50.289ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crucible" } file = sled-storage/src/manager.rs:1431
5782025-01-22T09:19:50.337ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5792025-01-22T09:19:50.337ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5802025-01-22T09:19:50.337ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_bbff868b-4199-4969-b27b-36834c92fe00/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5812025-01-22T09:19:50.387ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5822025-01-22T09:19:50.387ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5832025-01-22T09:19:50.387ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crucible" } file = sled-storage/src/manager.rs:1431
5842025-01-22T09:19:50.437ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5852025-01-22T09:19:50.437ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5862025-01-22T09:19:50.437ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38/crucible" } file = sled-storage/src/manager.rs:1431
5872025-01-22T09:19:50.485ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5882025-01-22T09:19:50.485ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5892025-01-22T09:19:50.485ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone/oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76"), full_name: "oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone/oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76" } file = sled-storage/src/manager.rs:1431
5902025-01-22T09:19:50.544ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5912025-01-22T09:19:50.544ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5922025-01-22T09:19:50.544ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf" } file = sled-storage/src/manager.rs:1431
5932025-01-22T09:19:50.605ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5942025-01-22T09:19:50.605ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5952025-01-22T09:19:50.605ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598" } file = sled-storage/src/manager.rs:1431
5962025-01-22T09:19:50.667ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5972025-01-22T09:19:50.667ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5982025-01-22T09:19:50.667ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone" } file = sled-storage/src/manager.rs:1431
5992025-01-22T09:19:50.696ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6002025-01-22T09:19:50.696ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6012025-01-22T09:19:50.696ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4091af72-7d1b-4529-85f2-2ca5bec8f750/crypt/zone"), full_name: "oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750/crypt/zone" } file = sled-storage/src/manager.rs:1431
6022025-01-22T09:19:50.720ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/probe_manager.rs:231 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
6032025-01-22T09:19:50.725ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042025-01-22T09:19:50.725ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6052025-01-22T09:19:50.725ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/debug"), full_name: "oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/debug" } file = sled-storage/src/manager.rs:1431
6062025-01-22T09:19:50.754ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072025-01-22T09:19:50.754ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082025-01-22T09:19:50.754ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807" } file = sled-storage/src/manager.rs:1431
6092025-01-22T09:19:50.815ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102025-01-22T09:19:50.815ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112025-01-22T09:19:50.815ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6122025-01-22T09:19:50.866ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-01-22T09:19:50.866ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6142025-01-22T09:19:50.866ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b03e8f4b-60f0-4c52-958e-2f9571749b38/crypt/debug"), full_name: "oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38/crypt/debug" } file = sled-storage/src/manager.rs:1431
6152025-01-22T09:19:50.895ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-01-22T09:19:50.895ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6172025-01-22T09:19:50.895ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b"), full_name: "oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/zone/oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b" } file = sled-storage/src/manager.rs:1431
6182025-01-22T09:19:50.956ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-01-22T09:19:50.956ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6202025-01-22T09:19:50.956ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/zone"), full_name: "oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/zone" } file = sled-storage/src/manager.rs:1431
6212025-01-22T09:19:50.985ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-01-22T09:19:50.985ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232025-01-22T09:19:50.985ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/zone/oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa" } file = sled-storage/src/manager.rs:1431
6242025-01-22T09:19:51.046ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-01-22T09:19:51.046ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6262025-01-22T09:19:51.046ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/2be08399-4b95-4cf8-9177-fa1c2f515fe8/crypt/debug"), full_name: "oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8/crypt/debug" } file = sled-storage/src/manager.rs:1431
6272025-01-22T09:19:51.075ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6282025-01-22T09:19:51.075ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6292025-01-22T09:19:51.075ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone/oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d"), full_name: "oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/zone/oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d" } file = sled-storage/src/manager.rs:1431
6302025-01-22T09:19:51.134ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6312025-01-22T09:19:51.134ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6322025-01-22T09:19:51.134ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/dad37219-37a0-41c1-b1d5-db92f039358b/crypt/debug"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/debug" } file = sled-storage/src/manager.rs:1431
6332025-01-22T09:19:51.164ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6342025-01-22T09:19:51.164ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6352025-01-22T09:19:51.164ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6362025-01-22T09:19:51.215ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6372025-01-22T09:19:51.215ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6382025-01-22T09:19:51.215ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
6392025-01-22T09:19:51.266ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6402025-01-22T09:19:51.266ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6412025-01-22T09:19:51.266ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8/crucible" } file = sled-storage/src/manager.rs:1431
6422025-01-22T09:19:51.318ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6432025-01-22T09:19:51.318ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6442025-01-22T09:19:51.318ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/zone/oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2"), full_name: "oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/zone/oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2" } file = sled-storage/src/manager.rs:1431
6452025-01-22T09:19:51.379ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6462025-01-22T09:19:51.379ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6472025-01-22T09:19:51.379ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/b03e8f4b-60f0-4c52-958e-2f9571749b38/crypt/zone/oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4"), full_name: "oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38/crypt/zone/oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4" } file = sled-storage/src/manager.rs:1431
6482025-01-22T09:19:51.437ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6492025-01-22T09:19:51.437ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6502025-01-22T09:19:51.437ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
6512025-01-22T09:19:51.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3188055 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:33861 req_id = 0883c4bf-cdac-46a9-9bcd-90ec40b47108 response_code = 200 uri = /datasets
6522025-01-22T09:19:51.469ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: aaee6681-841a-430b-abff-ede182f6fa30 (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3e98a77-5a08-4d6b-a53c-c3dc405c3f77 (service), filesystem_pool: Some(ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 00ba62ae-6111-4ae5-ba3e-85c1a2193d6e (service), filesystem_pool: Some(ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6532025-01-22T09:19:51.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58652
6542025-01-22T09:19:51.469ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6552025-01-22T09:19:51.469ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, responder: ... }
6562025-01-22T09:19:51.479ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6572025-01-22T09:19:51.479ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6582025-01-22T09:19:51.487ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6592025-01-22T09:19:51.487ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6602025-01-22T09:19:51.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6612025-01-22T09:19:51.496ZINFOSledAgent (ServiceManager): No ledger in /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:188
6622025-01-22T09:19:51.496ZINFOSledAgent (ServiceManager): No ledger in /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:188
6632025-01-22T09:19:51.496ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6642025-01-22T09:19:51.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652025-01-22T09:19:51.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-22T09:19:51.540ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-22T09:19:51.594ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30 file = illumos-utils/src/zone.rs:325
6682025-01-22T09:19:51.598ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e file = illumos-utils/src/zone.rs:325
6692025-01-22T09:19:51.602ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77 file = illumos-utils/src/zone.rs:325
6702025-01-22T09:19:51.614ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30 file = illumos-utils/src/zone.rs:363
6712025-01-22T09:19:51.620ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e file = illumos-utils/src/zone.rs:363
6722025-01-22T09:19:51.623ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77 file = illumos-utils/src/zone.rs:363
6732025-01-22T09:19:51.728ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/probe_manager.rs:231 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
6742025-01-22T09:19:52.735ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/02eb3679-08e1-4d9d-a221-e5b8fe419fb5) file = sled-agent/src/probe_manager.rs:231 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
6752025-01-22T09:19:53.211ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6762025-01-22T09:19:53.562ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8468772593977771899 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
6772025-01-22T09:19:53.563ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7021105043586598428 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
6782025-01-22T09:19:53.688ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6792025-01-22T09:19:53.688ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6802025-01-22T09:19:53.688ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6812025-01-22T09:19:53.778ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6822025-01-22T09:19:53.778ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6832025-01-22T09:19:53.784ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6842025-01-22T09:19:53.784ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6852025-01-22T09:19:53.925ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
6862025-01-22T09:19:53.925ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
6872025-01-22T09:19:53.964ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
6882025-01-22T09:19:53.964ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
6892025-01-22T09:19:54.016ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
6902025-01-22T09:19:54.016ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
6912025-01-22T09:19:54.035ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
6922025-01-22T09:19:54.035ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
6932025-01-22T09:19:54.106ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
6942025-01-22T09:19:54.106ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
6952025-01-22T09:19:54.170ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6962025-01-22T09:19:54.171ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
6972025-01-22T09:19:54.175ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
6982025-01-22T09:19:54.182ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6992025-01-22T09:19:54.182ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7002025-01-22T09:19:54.202ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7012025-01-22T09:19:54.202ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7022025-01-22T09:19:54.240ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7032025-01-22T09:19:54.272ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7042025-01-22T09:19:54.272ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7052025-01-22T09:19:54.273ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7062025-01-22T09:19:54.273ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7072025-01-22T09:19:54.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30") failed: Property not found. retry in 68.449893ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7082025-01-22T09:19:54.320ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7092025-01-22T09:19:54.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e") failed: Property not found. retry in 26.57132ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7102025-01-22T09:19:54.332ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77") failed: Property not found. retry in 55.881431ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7112025-01-22T09:19:54.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e") failed: Property not found. retry in 110.357218ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7122025-01-22T09:19:54.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30") failed: Property not found. retry in 63.531806ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7132025-01-22T09:19:54.603ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7142025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7152025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7162025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7172025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7182025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7192025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7202025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7212025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7222025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7232025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7242025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7252025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7262025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7272025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7282025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7292025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7302025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7312025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7322025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7332025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7342025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7352025-01-22T09:19:54.603ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7362025-01-22T09:19:54.619ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e") failed: Property not found. retry in 220.363465ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7372025-01-22T09:19:54.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77") failed: Property not found. retry in 106.394639ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7382025-01-22T09:19:54.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30") failed: Property not found. retry in 240.145093ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7392025-01-22T09:19:54.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77") failed: Property not found. retry in 120.820181ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7402025-01-22T09:19:54.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e") failed: Property not found. retry in 291.383117ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7412025-01-22T09:19:54.869ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7697435198695744416 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
7422025-01-22T09:19:54.869ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5436863415136858457 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
7432025-01-22T09:19:55.008ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77") failed: Property not found. retry in 390.788236ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7442025-01-22T09:19:55.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30") failed: Property not found. retry in 226.165583ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7452025-01-22T09:19:55.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e") failed: Property not found. retry in 831.883249ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7462025-01-22T09:19:55.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30") failed: Property not found. retry in 686.377301ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7472025-01-22T09:19:55.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77") failed: Property not found. retry in 528.311324ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7482025-01-22T09:19:55.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77") failed: Property not found. retry in 997.252636ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7492025-01-22T09:19:55.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30") failed: Property not found. retry in 1.498586276s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7502025-01-22T09:19:56.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e") failed: Property not found. retry in 1.292060065s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7512025-01-22T09:19:56.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77") failed: Property not found. retry in 1.310802122s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7522025-01-22T09:19:57.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e") failed: Property not found. retry in 1.074109995s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7532025-01-22T09:19:57.466ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30") failed: Property not found. retry in 1.199515854s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7542025-01-22T09:19:58.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77") failed: Property not found. retry in 901.883565ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7552025-01-22T09:19:58.398ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e") failed: Property not found. retry in 538.562826ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7562025-01-22T09:19:58.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30") failed: Property not found. retry in 917.914064ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7572025-01-22T09:19:58.946ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e") failed: Property not found. retry in 1.363297994s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7582025-01-22T09:19:59.182ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77") failed: Property not found. retry in 1.35129464s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7592025-01-22T09:20:00.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_aaee6681-841a-430b-abff-ede182f6fa30
7602025-01-22T09:20:00.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_00ba62ae-6111-4ae5-ba3e-85c1a2193d6e
7612025-01-22T09:20:00.553ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_b3e98a77-5a08-4d6b-a53c-c3dc405c3f77
7622025-01-22T09:20:00.554ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7632025-01-22T09:20:00.554ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7642025-01-22T09:20:00.554ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9085113 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:58652 req_id = ce2ce776-c336-4bba-851c-edab620c392c response_code = 204 uri = /omicron-zones
7652025-01-22T09:20:00.556ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7662025-01-22T09:20:00.604ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7672025-01-22T09:20:00.652ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7682025-01-22T09:20:00.699ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7692025-01-22T09:20:00.699ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7702025-01-22T09:20:00.734ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7712025-01-22T09:20:00.735ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7722025-01-22T09:20:00.735ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7732025-01-22T09:20:00.764ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: aaee6681-841a-430b-abff-ede182f6fa30 (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3e98a77-5a08-4d6b-a53c-c3dc405c3f77 (service), filesystem_pool: Some(ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 00ba62ae-6111-4ae5-ba3e-85c1a2193d6e (service), filesystem_pool: Some(ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: feb2145e-1275-4d3d-b888-601a4dbd609e (service), filesystem_pool: Some(ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a62a428d-1a9c-4683-86ce-eee82f3304cc, kind: Service { id: feb2145e-1275-4d3d-b888-601a4dbd609e }, name: Name("ntp-feb2145e-1275-4d3d-b888-601a4dbd609e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 163])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7742025-01-22T09:20:00.764ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62770
7752025-01-22T09:20:00.764ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7762025-01-22T09:20:00.764ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, responder: ... }
7772025-01-22T09:20:00.775ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7782025-01-22T09:20:00.775ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7792025-01-22T09:20:00.784ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7802025-01-22T09:20:00.784ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7812025-01-22T09:20:00.794ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7822025-01-22T09:20:00.794ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:177
7832025-01-22T09:20:00.794ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:177
7842025-01-22T09:20:00.794ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7852025-01-22T09:20:00.806ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7862025-01-22T09:20:00.838ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7872025-01-22T09:20:00.838ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7882025-01-22T09:20:00.838ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7892025-01-22T09:20:00.868ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 155, 163]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7902025-01-22T09:20:00.868ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7912025-01-22T09:20:00.868ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7922025-01-22T09:20:00.868ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7932025-01-22T09:20:00.869ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7942025-01-22T09:20:00.870ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7952025-01-22T09:20:00.895ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e file = illumos-utils/src/zone.rs:325
7962025-01-22T09:20:00.914ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e file = illumos-utils/src/zone.rs:363
7972025-01-22T09:20:01.582ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7982025-01-22T09:20:01.582ZINFOSledAgent (ServiceManager): Booting oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
7992025-01-22T09:20:01.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e") failed: Property not found. retry in 72.712166ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
8002025-01-22T09:20:01.809ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e") failed: Property not found. retry in 88.963306ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
8012025-01-22T09:20:01.909ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e") failed: Property not found. retry in 247.58463ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
8022025-01-22T09:20:02.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e") failed: Property not found. retry in 490.527062ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
8032025-01-22T09:20:02.665ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e") failed: Property not found. retry in 1.100454695s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
8042025-01-22T09:20:03.564ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8468772593977771899 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8052025-01-22T09:20:03.565ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7021105043586598428 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8062025-01-22T09:20:03.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e") failed: Property not found. retry in 1.352044397s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
8072025-01-22T09:20:04.871ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7697435198695744416 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8082025-01-22T09:20:04.871ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5436863415136858457 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8092025-01-22T09:20:05.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e") failed: Property not found. retry in 1.043693726s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
8102025-01-22T09:20:06.190ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e") failed: Property not found. retry in 1.263081482s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
8112025-01-22T09:20:07.473ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e
8122025-01-22T09:20:07.473ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8132025-01-22T09:20:07.473ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8142025-01-22T09:20:07.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6709515 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:62770 req_id = 784d06cb-4f33-432d-b13e-51b5d293bd9e response_code = 204 uri = /omicron-zones
8152025-01-22T09:20:07.476ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8162025-01-22T09:20:07.505ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8172025-01-22T09:20:07.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:65018
8182025-01-22T09:20:07.513ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8192025-01-22T09:20:07.514ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 7890 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:65018 req_id = 4695cd3b-b4eb-404f-a439-168a7370e41f response_code = 500 uri = /timesync
8202025-01-22T09:20:07.516ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8212025-01-22T09:20:07.611ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8222025-01-22T09:20:07.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:38722
8232025-01-22T09:20:11.619ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8242025-01-22T09:20:11.619ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4007716 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:38722 req_id = 8f325e30-a463-48cd-aceb-aa29e1adc0f0 response_code = 500 uri = /timesync
8252025-01-22T09:20:11.621ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12326255623737709618 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8262025-01-22T09:20:11.622ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16031126106161312216 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8272025-01-22T09:20:11.622ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18341512282502888085 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8282025-01-22T09:20:11.623ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8292025-01-22T09:20:11.774ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8302025-01-22T09:20:11.774ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39990
8312025-01-22T09:20:11.784ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8322025-01-22T09:20:11.784ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9214 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39990 req_id = 2faf792f-2e9d-4701-a2f0-25cf3a414cb1 response_code = 500 uri = /timesync
8332025-01-22T09:20:11.786ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8342025-01-22T09:20:11.939ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8352025-01-22T09:20:11.940ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47465
8362025-01-22T09:20:13.568ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8468772593977771899 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8372025-01-22T09:20:13.568ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7021105043586598428 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8382025-01-22T09:20:14.303ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7697435198695744416 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8392025-01-22T09:20:14.303ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5436863415136858457 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8402025-01-22T09:20:15.661ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_feb2145e-1275-4d3d-b888-601a4dbd609e': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8412025-01-22T09:20:15.661ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4009490 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47465 req_id = f1e384d7-7d29-442f-a172-ab7a16b85305 response_code = 500 uri = /timesync
8422025-01-22T09:20:15.664ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8432025-01-22T09:20:15.877ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8442025-01-22T09:20:15.877ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60600
8452025-01-22T09:20:15.886ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8764 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60600 req_id = b6d0791b-1b75-47fb-99aa-dccb77c0abc1 response_code = 200 uri = /timesync
8462025-01-22T09:20:15.888ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8472025-01-22T09:20:15.888ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8482025-01-22T09:20:16.242ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8492025-01-22T09:20:16.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40934
8502025-01-22T09:20:16.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9350 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40934 req_id = d3174c56-7ad3-4330-9ead-0bfcb704a5a9 response_code = 200 uri = /timesync
8512025-01-22T09:20:16.255ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8522025-01-22T09:20:16.255ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8532025-01-22T09:20:16.513ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8542025-01-22T09:20:16.513ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:39798
8552025-01-22T09:20:16.521ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8041 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:39798 req_id = 90e99b3c-f5fb-4aed-8d42-db578cb95d58 response_code = 200 uri = /timesync
8562025-01-22T09:20:16.524ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8572025-01-22T09:20:16.524ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8582025-01-22T09:20:16.781ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8592025-01-22T09:20:16.781ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56304
8602025-01-22T09:20:16.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8074 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56304 req_id = d08609e2-7486-41f3-9570-c188214ec9b4 response_code = 200 uri = /timesync
8612025-01-22T09:20:16.791ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8622025-01-22T09:20:16.791ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8632025-01-22T09:20:17.154ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8642025-01-22T09:20:17.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43513
8652025-01-22T09:20:17.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43513 req_id = 655a5e47-d955-481b-a1fc-3883cb187715 response_code = 200 uri = /timesync
8662025-01-22T09:20:17.165ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.076543875 } file = sled-agent/src/rack_setup/service.rs:743
8672025-01-22T09:20:17.165ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8682025-01-22T09:20:17.285ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12917597392718751016 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8692025-01-22T09:20:17.285ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14841244691226554753 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8702025-01-22T09:20:17.494ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8712025-01-22T09:20:17.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58944
8722025-01-22T09:20:17.502ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7677 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58944 req_id = b4fb2c7b-8c73-4176-8a92-8f055ff37bf7 response_code = 200 uri = /timesync
8732025-01-22T09:20:17.505ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.075626455 } file = sled-agent/src/rack_setup/service.rs:743
8742025-01-22T09:20:17.505ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8752025-01-22T09:20:17.802ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8762025-01-22T09:20:17.802ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47721
8772025-01-22T09:20:17.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7903 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:47721 req_id = ee2011da-cce5-4e0c-80f4-b89c4e0fdb79 response_code = 200 uri = /timesync
8782025-01-22T09:20:17.814ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.074793443 } file = sled-agent/src/rack_setup/service.rs:743
8792025-01-22T09:20:17.814ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8802025-01-22T09:20:18.191ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8812025-01-22T09:20:18.192ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46936
8822025-01-22T09:20:18.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7754 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46936 req_id = 13eb22c8-2039-482e-a755-e42d90396e19 response_code = 200 uri = /timesync
8832025-01-22T09:20:18.203ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.085893571 } file = sled-agent/src/rack_setup/service.rs:743
8842025-01-22T09:20:18.203ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8852025-01-22T09:20:18.779ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 308.888934ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
8862025-01-22T09:20:19.193ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8872025-01-22T09:20:19.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:58313
8882025-01-22T09:20:19.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8264 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:58313 req_id = a73f8f6f-966b-4e1d-ace4-0cbd3fe9244d response_code = 200 uri = /timesync
8892025-01-22T09:20:19.205ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1662783218, ip_addr: 99.28.14.242, stratum: 2, ref_time: 1737537619.1260974, correction: 0.077915855 } file = sled-agent/src/rack_setup/service.rs:743
8902025-01-22T09:20:19.205ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8912025-01-22T09:20:20.222ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8922025-01-22T09:20:20.222ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33911
8932025-01-22T09:20:20.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8985 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33911 req_id = 479efe6e-4d4c-4ae5-b0b3-ad10e9aa86b4 response_code = 200 uri = /timesync
8942025-01-22T09:20:20.233ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.070586957 } file = sled-agent/src/rack_setup/service.rs:743
8952025-01-22T09:20:20.233ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8962025-01-22T09:20:20.985ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8972025-01-22T09:20:20.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62564
8982025-01-22T09:20:20.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9080 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62564 req_id = 74c8e9fb-492d-4fab-ab74-19b85dcf7ade response_code = 200 uri = /timesync
8992025-01-22T09:20:20.997ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 2139029761, ip_addr: ::, stratum: 10, ref_time: 1737537613.7832472, correction: 0.068525389 } file = sled-agent/src/rack_setup/service.rs:743
9002025-01-22T09:20:20.997ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9012025-01-22T09:20:21.442ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12326255623737709618 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
9022025-01-22T09:20:21.442ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16031126106161312216 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
9032025-01-22T09:20:21.442ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18341512282502888085 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
9042025-01-22T09:20:22.414ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9052025-01-22T09:20:22.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60944
9062025-01-22T09:20:22.423ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9035 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60944 req_id = c857af2c-cdcd-41ab-b212-3d38f3335a74 response_code = 200 uri = /timesync
9072025-01-22T09:20:22.427ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1662783218, ip_addr: 99.28.14.242, stratum: 2, ref_time: 1737537622.096948, correction: 0.061726127 } file = sled-agent/src/rack_setup/service.rs:743
9082025-01-22T09:20:22.427ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9092025-01-22T09:20:23.393ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 8468772593977771899 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
9102025-01-22T09:20:23.393ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7021105043586598428 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
9112025-01-22T09:20:23.812ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36898
9122025-01-22T09:20:23.813ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36898 req_id = b89e1aec-ecfd-40d7-bc1f-f6d9807dec19 response_code = 200 uri = /baseboard
9132025-01-22T09:20:23.878ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9142025-01-22T09:20:23.878ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:62522
9152025-01-22T09:20:23.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8862 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:62522 req_id = b16bd6bc-8437-421c-98bd-00b1f5b03f85 response_code = 200 uri = /timesync
9162025-01-22T09:20:23.891ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1662783218, ip_addr: 99.28.14.242, stratum: 2, ref_time: 1737537623.1958165, correction: 0.057623271 } file = sled-agent/src/rack_setup/service.rs:743
9172025-01-22T09:20:23.891ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9182025-01-22T09:20:24.702ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 7697435198695744416 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
9192025-01-22T09:20:24.702ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 5436863415136858457 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
9202025-01-22T09:20:25.460ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9212025-01-22T09:20:25.460ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54131
9222025-01-22T09:20:25.469ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8850 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54131 req_id = 45ec5929-0375-4840-a51e-1730b1c71343 response_code = 200 uri = /timesync
9232025-01-22T09:20:25.473ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1662783218, ip_addr: 99.28.14.242, stratum: 2, ref_time: 1737537625.1942046, correction: 0.053009927 } file = sled-agent/src/rack_setup/service.rs:743
9242025-01-22T09:20:25.473ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9252025-01-22T09:20:27.313ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 12917597392718751016 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
9262025-01-22T09:20:27.313ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 14841244691226554753 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
9272025-01-22T09:20:28.346ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9282025-01-22T09:20:28.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:33811
9292025-01-22T09:20:28.368ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 21302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:33811 req_id = 802e5dcc-96c5-4236-9fff-c4fedbfc3369 response_code = 200 uri = /timesync
9302025-01-22T09:20:28.372ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1662783218, ip_addr: 99.28.14.242, stratum: 2, ref_time: 1737537627.9213717, correction: 0.044640753 } file = sled-agent/src/rack_setup/service.rs:743
9312025-01-22T09:20:28.372ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
9322025-01-22T09:20:28.401ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: aaee6681-841a-430b-abff-ede182f6fa30 (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3e98a77-5a08-4d6b-a53c-c3dc405c3f77 (service), filesystem_pool: Some(ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 00ba62ae-6111-4ae5-ba3e-85c1a2193d6e (service), filesystem_pool: Some(ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: feb2145e-1275-4d3d-b888-601a4dbd609e (service), filesystem_pool: Some(ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a62a428d-1a9c-4683-86ce-eee82f3304cc, kind: Service { id: feb2145e-1275-4d3d-b888-601a4dbd609e }, name: Name("ntp-feb2145e-1275-4d3d-b888-601a4dbd609e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 163])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2c38671b-bb64-4215-8093-8b43da8f5f2d (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } } } }, OmicronZoneConfig { id: b7d98f66-ded0-4c33-9bdf-cabb71ee6807 (service), filesystem_pool: Some(ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External } } } }, OmicronZoneConfig { id: c812e844-b056-4df2-8019-61ec6ae926cb (service), filesystem_pool: Some(ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External } } } }, OmicronZoneConfig { id: dabbe319-022e-4f9a-9073-6fd798a423b2 (service), filesystem_pool: Some(ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6e195b69-f53f-4e60-9cf0-d3deca3c402d (service), filesystem_pool: Some(ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
9332025-01-22T09:20:28.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37022
9342025-01-22T09:20:28.401ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9352025-01-22T09:20:28.401ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, responder: ... }
9362025-01-22T09:20:28.413ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9372025-01-22T09:20:28.413ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9382025-01-22T09:20:28.423ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
9392025-01-22T09:20:28.423ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, responder: ... }
9402025-01-22T09:20:28.432ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9412025-01-22T09:20:28.433ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Cockroach }, responder: ... }
9422025-01-22T09:20:28.442ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9432025-01-22T09:20:28.442ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9442025-01-22T09:20:28.451ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9452025-01-22T09:20:28.451ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9462025-01-22T09:20:28.460ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9472025-01-22T09:20:28.460ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9482025-01-22T09:20:28.469ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
9492025-01-22T09:20:28.469ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Cockroach }, responder: ... }
9502025-01-22T09:20:28.478ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9512025-01-22T09:20:28.478ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:177
9522025-01-22T09:20:28.478ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:177
9532025-01-22T09:20:28.478ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9542025-01-22T09:20:28.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9552025-01-22T09:20:28.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9562025-01-22T09:20:28.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9572025-01-22T09:20:28.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9582025-01-22T09:20:28.559ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
9592025-01-22T09:20:28.647ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d file = illumos-utils/src/zone.rs:325
9602025-01-22T09:20:28.651ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d file = illumos-utils/src/zone.rs:325
9612025-01-22T09:20:28.655ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb file = illumos-utils/src/zone.rs:325
9622025-01-22T09:20:28.660ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807 file = illumos-utils/src/zone.rs:325
9632025-01-22T09:20:28.665ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2 file = illumos-utils/src/zone.rs:325
9642025-01-22T09:20:28.670ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d file = illumos-utils/src/zone.rs:363
9652025-01-22T09:20:28.674ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d file = illumos-utils/src/zone.rs:363
9662025-01-22T09:20:28.679ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb file = illumos-utils/src/zone.rs:363
9672025-01-22T09:20:28.683ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807 file = illumos-utils/src/zone.rs:363
9682025-01-22T09:20:28.688ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2 file = illumos-utils/src/zone.rs:363
9692025-01-22T09:20:32.905ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='dabbe319-022e-4f9a-9073-6fd798a423b2'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9702025-01-22T09:20:32.905ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
9712025-01-22T09:20:32.926ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='2c38671b-bb64-4215-8093-8b43da8f5f2d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9722025-01-22T09:20:32.926ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
9732025-01-22T09:20:32.972ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b7d98f66-ded0-4c33-9bdf-cabb71ee6807'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9742025-01-22T09:20:32.973ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
9752025-01-22T09:20:32.980ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='c812e844-b056-4df2-8019-61ec6ae926cb'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9762025-01-22T09:20:32.980ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
9772025-01-22T09:20:32.986ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='6e195b69-f53f-4e60-9cf0-d3deca3c402d'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
9782025-01-22T09:20:32.986ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
9792025-01-22T09:20:33.093ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 28.151643ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
9802025-01-22T09:20:33.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 35.718389ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
9812025-01-22T09:20:33.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 51.683441ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
9822025-01-22T09:20:33.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 31.358144ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
9832025-01-22T09:20:33.152ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 104.086155ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
9842025-01-22T09:20:33.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 71.079341ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
9852025-01-22T09:20:33.168ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 67.643733ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
9862025-01-22T09:20:33.184ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 55.622335ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
9872025-01-22T09:20:33.194ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 276.784743ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
9882025-01-22T09:20:33.239ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 63.155368ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
9892025-01-22T09:20:33.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 112.236143ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
9902025-01-22T09:20:33.253ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 197.610526ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
9912025-01-22T09:20:33.267ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 214.546075ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
9922025-01-22T09:20:33.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 242.087554ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
9932025-01-22T09:20:33.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 177.225269ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
9942025-01-22T09:20:33.462ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 292.989015ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
9952025-01-22T09:20:33.485ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 500.193118ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
9962025-01-22T09:20:33.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 209.507844ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
9972025-01-22T09:20:33.557ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 439.669296ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
9982025-01-22T09:20:33.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 539.665752ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
9992025-01-22T09:20:33.964ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 767.293572ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10002025-01-22T09:20:33.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 1.190546656s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10012025-01-22T09:20:34.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 537.048365ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10022025-01-22T09:20:34.054ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 711.014679ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10032025-01-22T09:20:34.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 545.706171ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10042025-01-22T09:20:34.165ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 311.711594ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
10052025-01-22T09:20:34.576ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 1.239220297s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10062025-01-22T09:20:34.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 1.187225432s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10072025-01-22T09:20:34.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 1.49181413s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10082025-01-22T09:20:34.774ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 590.243983ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10092025-01-22T09:20:35.198ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 1.062386533s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10102025-01-22T09:20:35.375ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 879.819539ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10112025-01-22T09:20:35.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 1.303698602s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10122025-01-22T09:20:35.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 1.415031028s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10132025-01-22T09:20:36.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 632.843148ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10142025-01-22T09:20:36.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 653.959564ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10152025-01-22T09:20:36.273ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 532.236928ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10162025-01-22T09:20:36.817ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 789.756018ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10172025-01-22T09:20:36.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 1.224367363s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10182025-01-22T09:20:36.930ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 1.20657482s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10192025-01-22T09:20:37.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 512.622156ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10202025-01-22T09:20:37.329ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 972.097431ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10212025-01-22T09:20:37.618ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 1.450152905s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10222025-01-22T09:20:37.667ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 1.078092933s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10232025-01-22T09:20:38.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 589.934075ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10242025-01-22T09:20:38.149ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 1.286357651s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10252025-01-22T09:20:38.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 568.38377ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10262025-01-22T09:20:38.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 895.430489ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10272025-01-22T09:20:38.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 635.631503ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10282025-01-22T09:20:38.892ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 1.223836604s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10292025-01-22T09:20:39.081ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 802.53586ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10302025-01-22T09:20:39.404ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 885.837907ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10312025-01-22T09:20:39.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 1.231627471s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10322025-01-22T09:20:39.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 1.35390137s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10332025-01-22T09:20:39.895ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 1.142680588s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10342025-01-22T09:20:40.128ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 602.328449ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10352025-01-22T09:20:40.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 954.29884ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10362025-01-22T09:20:40.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 1.390082405s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10372025-01-22T09:20:40.742ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 708.481021ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10382025-01-22T09:20:41.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 927.866084ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10392025-01-22T09:20:41.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 807.940932ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10402025-01-22T09:20:41.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 808.839934ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10412025-01-22T09:20:41.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 1.058751633s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10422025-01-22T09:20:41.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 621.252476ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10432025-01-22T09:20:41.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 598.092377ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10442025-01-22T09:20:42.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 1.450837484s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10452025-01-22T09:20:42.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 663.185989ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10462025-01-22T09:20:42.506ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 1.446218179s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10472025-01-22T09:20:42.532ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 754.866826ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10482025-01-22T09:20:42.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 742.76236ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10492025-01-22T09:20:42.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 911.01121ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10502025-01-22T09:20:43.297ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 679.267708ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10512025-01-22T09:20:43.306ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 642.636505ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10522025-01-22T09:20:43.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 646.132974ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10532025-01-22T09:20:43.692ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 1.094176865s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10542025-01-22T09:20:43.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 865.748979ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10552025-01-22T09:20:43.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 500.707007ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10562025-01-22T09:20:43.986ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 1.245811007s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10572025-01-22T09:20:44.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2") failed: Property not found. retry in 1.483400675s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10582025-01-22T09:20:44.479ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb") failed: Property not found. retry in 1.182906634s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10592025-01-22T09:20:44.799ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d") failed: Property not found. retry in 1.171816036s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10602025-01-22T09:20:44.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d") failed: Property not found. retry in 989.669241ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10612025-01-22T09:20:45.245ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807") failed: Property not found. retry in 1.032222137s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10622025-01-22T09:20:46.303ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_6e195b69-f53f-4e60-9cf0-d3deca3c402d
10632025-01-22T09:20:46.303ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d
10642025-01-22T09:20:46.303ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_c812e844-b056-4df2-8019-61ec6ae926cb
10652025-01-22T09:20:46.303ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_b7d98f66-ded0-4c33-9bdf-cabb71ee6807
10662025-01-22T09:20:46.303ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_dabbe319-022e-4f9a-9073-6fd798a423b2
10672025-01-22T09:20:46.303ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10682025-01-22T09:20:46.304ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
10692025-01-22T09:20:46.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 17856879 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:37022 req_id = 385d4f18-600d-444a-8380-121a7dea14e3 response_code = 204 uri = /omicron-zones
10702025-01-22T09:20:46.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:47213
10712025-01-22T09:20:46.367ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 30036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47213 req_id = 8376e503-be7c-4a86-aa26-869d47ff3106 response_code = 500 uri = /cockroachdb
10722025-01-22T09:20:46.368ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "8376e503-be7c-4a86-aa26-869d47ff3106", "content-length": "124", "date": "Wed, 22 Jan 2025 09:20:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "8376e503-be7c-4a86-aa26-869d47ff3106" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 81.485247ms
10732025-01-22T09:20:46.478ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26727 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47213 req_id = 7dcddc53-5aa0-48e4-a29c-74cafb3d19a3 response_code = 500 uri = /cockroachdb
10742025-01-22T09:20:46.478ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7dcddc53-5aa0-48e4-a29c-74cafb3d19a3", "content-length": "124", "date": "Wed, 22 Jan 2025 09:20:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7dcddc53-5aa0-48e4-a29c-74cafb3d19a3" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 123.431489ms
10752025-01-22T09:20:46.632ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 29879 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47213 req_id = 632c4d0c-cbc6-4905-9758-089b08f86938 response_code = 500 uri = /cockroachdb
10762025-01-22T09:20:46.632ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "632c4d0c-cbc6-4905-9758-089b08f86938", "content-length": "124", "date": "Wed, 22 Jan 2025 09:20:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "632c4d0c-cbc6-4905-9758-089b08f86938" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 124.87282ms
10772025-01-22T09:20:46.787ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28702 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47213 req_id = c42fb919-57b8-4f4a-a91c-4f6d9bfb0bf9 response_code = 500 uri = /cockroachdb
10782025-01-22T09:20:46.788ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c42fb919-57b8-4f4a-a91c-4f6d9bfb0bf9", "content-length": "124", "date": "Wed, 22 Jan 2025 09:20:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c42fb919-57b8-4f4a-a91c-4f6d9bfb0bf9" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 140.217948ms
10792025-01-22T09:20:46.955ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26191 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47213 req_id = c24461ec-625f-4a75-9317-243c26448e5a response_code = 500 uri = /cockroachdb
10802025-01-22T09:20:46.955ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c24461ec-625f-4a75-9317-243c26448e5a", "content-length": "124", "date": "Wed, 22 Jan 2025 09:20:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c24461ec-625f-4a75-9317-243c26448e5a" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 163.299098ms
10812025-01-22T09:20:47.148ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28787 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47213 req_id = d3a9c7ae-1c74-4f25-91c4-c1b16684c2ea response_code = 500 uri = /cockroachdb
10822025-01-22T09:20:47.148ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "d3a9c7ae-1c74-4f25-91c4-c1b16684c2ea", "content-length": "124", "date": "Wed, 22 Jan 2025 09:20:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "d3a9c7ae-1c74-4f25-91c4-c1b16684c2ea" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 327.882877ms
10832025-01-22T09:20:47.507ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_2c38671b-bb64-4215-8093-8b43da8f5f2d /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 29546 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47213 req_id = 366154c2-43d7-487d-bf7c-a2b0848ee51a response_code = 500 uri = /cockroachdb
10842025-01-22T09:20:47.507ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "366154c2-43d7-487d-bf7c-a2b0848ee51a", "content-length": "124", "date": "Wed, 22 Jan 2025 09:20:47 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "366154c2-43d7-487d-bf7c-a2b0848ee51a" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 263.876902ms
10852025-01-22T09:20:47.804ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::3]:32221 file = sled-agent/src/services.rs:3752
10862025-01-22T09:21:09.904ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
10872025-01-22T09:21:16.999ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
10882025-01-22T09:21:17.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29227919 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:47213 req_id = d2b2f722-c602-44f0-89ed-13389989f602 response_code = 204 uri = /cockroachdb
10892025-01-22T09:21:17.004ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61828
10902025-01-22T09:21:17.018ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 882.96299ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
10912025-01-22T09:21:17.052ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: aaee6681-841a-430b-abff-ede182f6fa30 (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: b3e98a77-5a08-4d6b-a53c-c3dc405c3f77 (service), filesystem_pool: Some(ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 00ba62ae-6111-4ae5-ba3e-85c1a2193d6e (service), filesystem_pool: Some(ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: feb2145e-1275-4d3d-b888-601a4dbd609e (service), filesystem_pool: Some(ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: a62a428d-1a9c-4683-86ce-eee82f3304cc, kind: Service { id: feb2145e-1275-4d3d-b888-601a4dbd609e }, name: Name("ntp-feb2145e-1275-4d3d-b888-601a4dbd609e"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 155, 163])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: 2c38671b-bb64-4215-8093-8b43da8f5f2d (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } } } }, OmicronZoneConfig { id: b7d98f66-ded0-4c33-9bdf-cabb71ee6807 (service), filesystem_pool: Some(ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External } } } }, OmicronZoneConfig { id: c812e844-b056-4df2-8019-61ec6ae926cb (service), filesystem_pool: Some(ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External } } } }, OmicronZoneConfig { id: dabbe319-022e-4f9a-9073-6fd798a423b2 (service), filesystem_pool: Some(ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 6e195b69-f53f-4e60-9cf0-d3deca3c402d (service), filesystem_pool: Some(ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External } } } }, OmicronZoneConfig { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa (service), filesystem_pool: Some(ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: f355370f-27f8-480f-a075-c338511729ae (service), filesystem_pool: Some(ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df (service), filesystem_pool: Some(ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: afc461c5-5a34-4bdf-8818-07fb287a6a77 (service), filesystem_pool: Some(ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: acd25015-8676-47ab-894b-39c025f1c2fa (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } } } }, OmicronZoneConfig { id: 48eb66d5-ce02-46fd-9e84-bba4f177e630 (service), filesystem_pool: Some(ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 46cfad4e-b1a4-47c4-969c-bd50f68e0965 (service), filesystem_pool: Some(ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 03ec9fe8-b35c-4cd1-9c62-4c423c171b76 (service), filesystem_pool: Some(ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: 74c471b2-5b31-4348-9d86-0d0bd8adf26a (service), filesystem_pool: Some(ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External } } } }, OmicronZoneConfig { id: 34f00e5a-5f0c-4095-9441-c6a39fae032b (service), filesystem_pool: Some(ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1e7932d1-229e-464e-8be0-d00436be71ad (service), filesystem_pool: Some(ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External } } } }, OmicronZoneConfig { id: 53359eef-0654-46e2-9b84-03f87b50bfa0 (service), filesystem_pool: Some(ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 233783c1-a48b-4789-8fa4-09858248c7dd (service), filesystem_pool: Some(ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External } } } }, OmicronZoneConfig { id: 8d313403-04e5-42ba-830f-69162af01437 (service), filesystem_pool: Some(ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External } } } }, OmicronZoneConfig { id: 449b861e-6ed7-4b1c-977f-0b4cf34059bb (service), filesystem_pool: Some(ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External } } } }, OmicronZoneConfig { id: 1a041bed-d5dd-477f-a120-7e8d3b3cddb4 (service), filesystem_pool: Some(ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External } } } }, OmicronZoneConfig { id: 760efec7-e305-4d29-8d53-203649569f4a (service), filesystem_pool: Some(ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10922025-01-22T09:21:17.053ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59925
10932025-01-22T09:21:17.054ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10942025-01-22T09:21:17.054ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: InternalDns }, responder: ... }
10952025-01-22T09:21:17.069ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10962025-01-22T09:21:17.069ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10972025-01-22T09:21:17.081ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10982025-01-22T09:21:17.081ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10992025-01-22T09:21:17.092ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11002025-01-22T09:21:17.092ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Cockroach }, responder: ... }
11012025-01-22T09:21:17.104ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11022025-01-22T09:21:17.104ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11032025-01-22T09:21:17.114ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11042025-01-22T09:21:17.114ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11052025-01-22T09:21:17.125ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11062025-01-22T09:21:17.125ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11072025-01-22T09:21:17.136ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
11082025-01-22T09:21:17.136ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Cockroach }, responder: ... }
11092025-01-22T09:21:17.147ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11102025-01-22T09:21:17.147ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11112025-01-22T09:21:17.158ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
11122025-01-22T09:21:17.158ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: ExternalDns }, responder: ... }
11132025-01-22T09:21:17.170ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
11142025-01-22T09:21:17.170ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Clickhouse }, responder: ... }
11152025-01-22T09:21:17.181ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11162025-01-22T09:21:17.181ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, kind: Crucible }, responder: ... }
11172025-01-22T09:21:17.191ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11182025-01-22T09:21:17.191ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, kind: Crucible }, responder: ... }
11192025-01-22T09:21:17.201ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11202025-01-22T09:21:17.201ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, kind: Crucible }, responder: ... }
11212025-01-22T09:21:17.212ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11222025-01-22T09:21:17.212ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, kind: Crucible }, responder: ... }
11232025-01-22T09:21:17.223ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11242025-01-22T09:21:17.223ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, kind: Crucible }, responder: ... }
11252025-01-22T09:21:17.233ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11262025-01-22T09:21:17.234ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, kind: Crucible }, responder: ... }
11272025-01-22T09:21:17.245ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11282025-01-22T09:21:17.245ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, kind: Crucible }, responder: ... }
11292025-01-22T09:21:17.256ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11302025-01-22T09:21:17.256ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, kind: Crucible }, responder: ... }
11312025-01-22T09:21:17.266ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
11322025-01-22T09:21:17.266ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, kind: Crucible }, responder: ... }
11332025-01-22T09:21:17.277ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11342025-01-22T09:21:17.277ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:177
11352025-01-22T09:21:17.277ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:177
11362025-01-22T09:21:17.278ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11372025-01-22T09:21:17.394ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11382025-01-22T09:21:17.396ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11392025-01-22T09:21:17.437ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11402025-01-22T09:21:17.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11412025-01-22T09:21:17.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11422025-01-22T09:21:17.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11432025-01-22T09:21:17.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11442025-01-22T09:21:17.437ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11452025-01-22T09:21:17.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11462025-01-22T09:21:17.462ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11472025-01-22T09:21:17.610ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11482025-01-22T09:21:17.673ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
11492025-01-22T09:21:17.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11502025-01-22T09:21:17.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11512025-01-22T09:21:17.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11522025-01-22T09:21:17.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11532025-01-22T09:21:17.673ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11542025-01-22T09:21:17.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11552025-01-22T09:21:17.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
11562025-01-22T09:21:17.687ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630 file = illumos-utils/src/zone.rs:325
11572025-01-22T09:21:17.692ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76 file = illumos-utils/src/zone.rs:325
11582025-01-22T09:21:17.697ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a file = illumos-utils/src/zone.rs:325
11592025-01-22T09:21:17.702ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b file = illumos-utils/src/zone.rs:325
11602025-01-22T09:21:17.707ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4 file = illumos-utils/src/zone.rs:325
11612025-01-22T09:21:17.713ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa file = illumos-utils/src/zone.rs:325
11622025-01-22T09:21:17.718ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0 file = illumos-utils/src/zone.rs:325
11632025-01-22T09:21:17.868ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630 file = illumos-utils/src/zone.rs:363
11642025-01-22T09:21:17.873ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76 file = illumos-utils/src/zone.rs:363
11652025-01-22T09:21:17.879ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a file = illumos-utils/src/zone.rs:363
11662025-01-22T09:21:17.884ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b file = illumos-utils/src/zone.rs:363
11672025-01-22T09:21:17.889ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4 file = illumos-utils/src/zone.rs:363
11682025-01-22T09:21:17.894ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa file = illumos-utils/src/zone.rs:363
11692025-01-22T09:21:17.899ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0 file = illumos-utils/src/zone.rs:363
11702025-01-22T09:21:17.905ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77 file = illumos-utils/src/zone.rs:325
11712025-01-22T09:21:17.910ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd file = illumos-utils/src/zone.rs:325
11722025-01-22T09:21:17.917ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb file = illumos-utils/src/zone.rs:325
11732025-01-22T09:21:17.924ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad file = illumos-utils/src/zone.rs:325
11742025-01-22T09:21:17.930ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a file = illumos-utils/src/zone.rs:325
11752025-01-22T09:21:17.938ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_8d313403-04e5-42ba-830f-69162af01437 file = illumos-utils/src/zone.rs:325
11762025-01-22T09:21:17.945ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965 file = illumos-utils/src/zone.rs:325
11772025-01-22T09:21:18.061ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11782025-01-22T09:21:18.062ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77 file = illumos-utils/src/zone.rs:363
11792025-01-22T09:21:18.072ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd file = illumos-utils/src/zone.rs:363
11802025-01-22T09:21:18.081ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb file = illumos-utils/src/zone.rs:363
11812025-01-22T09:21:18.088ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad file = illumos-utils/src/zone.rs:363
11822025-01-22T09:21:18.095ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a file = illumos-utils/src/zone.rs:363
11832025-01-22T09:21:18.102ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_8d313403-04e5-42ba-830f-69162af01437 file = illumos-utils/src/zone.rs:363
11842025-01-22T09:21:18.109ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965 file = illumos-utils/src/zone.rs:363
11852025-01-22T09:21:18.170ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11862025-01-22T09:21:18.244ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11872025-01-22T09:21:18.431ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11882025-01-22T09:21:18.495ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
11892025-01-22T09:21:18.498ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11902025-01-22T09:21:18.498ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11912025-01-22T09:21:18.561ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 185, 231]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11922025-01-22T09:21:18.561ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11932025-01-22T09:21:18.564ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11942025-01-22T09:21:18.564ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11952025-01-22T09:21:18.626ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 149, 12]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
11962025-01-22T09:21:18.628ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
11972025-01-22T09:21:18.630ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
11982025-01-22T09:21:18.630ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
11992025-01-22T09:21:18.686ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 251, 13]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12002025-01-22T09:21:18.686ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12012025-01-22T09:21:18.687ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12022025-01-22T09:21:18.687ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12032025-01-22T09:21:18.744ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 185, 236]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12042025-01-22T09:21:18.744ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12052025-01-22T09:21:18.747ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
12062025-01-22T09:21:18.747ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
12072025-01-22T09:21:18.804ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 169, 102]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
12082025-01-22T09:21:18.804ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
12092025-01-22T09:21:18.805ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
12102025-01-22T09:21:18.805ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
12112025-01-22T09:21:18.805ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
12122025-01-22T09:21:18.805ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
12132025-01-22T09:21:18.805ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
12142025-01-22T09:21:18.805ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
12152025-01-22T09:21:18.805ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
12162025-01-22T09:21:18.805ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
12172025-01-22T09:21:18.828ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
12182025-01-22T09:21:18.830ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
12192025-01-22T09:21:18.832ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
12202025-01-22T09:21:18.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12212025-01-22T09:21:18.832ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12222025-01-22T09:21:18.835ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12232025-01-22T09:21:18.835ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
12242025-01-22T09:21:18.835ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
12252025-01-22T09:21:18.835ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
12262025-01-22T09:21:18.838ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12272025-01-22T09:21:19.000ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
12282025-01-22T09:21:19.054ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12292025-01-22T09:21:19.054ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf file = illumos-utils/src/zone.rs:325
12302025-01-22T09:21:19.066ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df file = illumos-utils/src/zone.rs:325
12312025-01-22T09:21:19.080ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598 file = illumos-utils/src/zone.rs:325
12322025-01-22T09:21:19.147ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa file = illumos-utils/src/zone.rs:325
12332025-01-22T09:21:19.157ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf file = illumos-utils/src/zone.rs:363
12342025-01-22T09:21:19.169ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df file = illumos-utils/src/zone.rs:363
12352025-01-22T09:21:19.180ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598 file = illumos-utils/src/zone.rs:363
12362025-01-22T09:21:19.192ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_f355370f-27f8-480f-a075-c338511729ae file = illumos-utils/src/zone.rs:325
12372025-01-22T09:21:19.204ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa file = illumos-utils/src/zone.rs:363
12382025-01-22T09:21:19.230ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_f355370f-27f8-480f-a075-c338511729ae file = illumos-utils/src/zone.rs:363
12392025-01-22T09:21:28.492ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12402025-01-22T09:21:28.607ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
12412025-01-22T09:21:29.484ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12422025-01-22T09:21:29.485ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
12432025-01-22T09:21:29.748ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_bbff868b-4199-4969-b27b-36834c92fe00/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4cc808e3-247e-49b7-a6f2-eb8bb81b3f76'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12442025-01-22T09:21:29.749ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_34031fe8-4691-4be6-a0d4-bb1591795113/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='6b52f4a8-2241-4958-8d3a-18684198b002'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12452025-01-22T09:21:29.749ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
12462025-01-22T09:21:29.756ZINFOSledAgent (ServiceManager): Booting oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
12472025-01-22T09:21:29.796ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_8d313403-04e5-42ba-830f-69162af01437: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='74717a93-f223-40df-9c12-7c8e8294ff6f'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12482025-01-22T09:21:29.845ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_dad37219-37a0-41c1-b1d5-db92f039358b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='bb6c2ed6-f567-4b5a-ba59-1f4cb6c11060'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12492025-01-22T09:21:29.846ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='245ab970-a2f5-407a-b8f7-21a4ee0f5701'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12502025-01-22T09:21:29.846ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='41617498-e899-4655-a898-78f39c1b84f6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12512025-01-22T09:21:29.846ZINFOSledAgent (ServiceManager): Booting oxz_crucible_8d313403-04e5-42ba-830f-69162af01437 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
12522025-01-22T09:21:29.853ZINFOSledAgent (ServiceManager): Booting oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
12532025-01-22T09:21:29.859ZINFOSledAgent (ServiceManager): Booting oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
12542025-01-22T09:21:29.866ZINFOSledAgent (ServiceManager): Booting oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
12552025-01-22T09:21:29.945ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='4df64c4d-933c-400c-ae4f-3b3836e153c8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12562025-01-22T09:21:29.946ZINFOSledAgent (ServiceManager): Booting oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
12572025-01-22T09:21:31.607ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='afc461c5-5a34-4bdf-8818-07fb287a6a77'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12582025-01-22T09:21:31.607ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
12592025-01-22T09:21:33.182ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.466448056s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
12602025-01-22T09:21:33.489ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 74.707944ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
12612025-01-22T09:21:33.497ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 40.983964ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
12622025-01-22T09:21:33.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 43.236702ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
12632025-01-22T09:21:33.546ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 60.443645ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
12642025-01-22T09:21:33.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 30.220204ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
12652025-01-22T09:21:33.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 49.026979ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
12662025-01-22T09:21:33.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 55.638425ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
12672025-01-22T09:21:33.610ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12682025-01-22T09:21:33.611ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e3397cfe-12f1-4108-926f-a385931525d6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12692025-01-22T09:21:33.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 62.407926ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
12702025-01-22T09:21:33.628ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 139.810281ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
12712025-01-22T09:21:33.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 141.145217ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
12722025-01-22T09:21:33.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 59.966102ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
12732025-01-22T09:21:33.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 63.621052ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
12742025-01-22T09:21:33.661ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 83.664574ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
12752025-01-22T09:21:33.661ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
12762025-01-22T09:21:33.667ZINFOSledAgent (ServiceManager): Booting oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
12772025-01-22T09:21:33.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 117.216064ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
12782025-01-22T09:21:33.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 79.486479ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
12792025-01-22T09:21:33.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 139.278397ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
12802025-01-22T09:21:33.704ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
12812025-01-22T09:21:33.705ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
12822025-01-22T09:21:33.723ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 120.146009ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
12832025-01-22T09:21:33.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 144.246591ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
12842025-01-22T09:21:33.761ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 216.444442ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
12852025-01-22T09:21:33.780ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 123.032355ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
12862025-01-22T09:21:33.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 156.871937ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
12872025-01-22T09:21:33.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 179.849963ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
12882025-01-22T09:21:33.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 295.130693ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
12892025-01-22T09:21:33.856ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 208.476911ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
12902025-01-22T09:21:33.870ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 502.230246ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
12912025-01-22T09:21:33.886ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 33.681489ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
12922025-01-22T09:21:33.899ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 298.161224ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
12932025-01-22T09:21:33.913ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 278.401966ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
12942025-01-22T09:21:33.924ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 33.616434ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
12952025-01-22T09:21:33.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 129.995127ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
12962025-01-22T09:21:33.952ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 52.535699ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
12972025-01-22T09:21:33.962ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 332.83918ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
12982025-01-22T09:21:34.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 99.636785ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
12992025-01-22T09:21:34.012ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 416.474801ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
13002025-01-22T09:21:34.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 591.615624ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
13012025-01-22T09:21:34.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 81.100689ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
13022025-01-22T09:21:34.077ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 225.197661ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
13032025-01-22T09:21:34.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 618.406693ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
13042025-01-22T09:21:34.112ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 275.680785ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
13052025-01-22T09:21:34.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 261.22285ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
13062025-01-22T09:21:34.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 213.087855ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
13072025-01-22T09:21:34.202ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 1.009897625s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
13082025-01-22T09:21:34.211ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 402.211952ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
13092025-01-22T09:21:34.305ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 404.389924ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
13102025-01-22T09:21:34.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 494.22045ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
13112025-01-22T09:21:34.356ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 319.618374ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
13122025-01-22T09:21:34.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 636.456013ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
13132025-01-22T09:21:34.391ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 1.168439082s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
13142025-01-22T09:21:34.399ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 538.815587ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
13152025-01-22T09:21:34.440ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 1.196059696s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
13162025-01-22T09:21:34.448ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_f355370f-27f8-480f-a075-c338511729ae: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13172025-01-22T09:21:34.448ZINFOSledAgent (ServiceManager): Booting oxz_nexus_f355370f-27f8-480f-a075-c338511729ae zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
13182025-01-22T09:21:34.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 36.167232ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
13192025-01-22T09:21:34.626ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 917.596187ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
13202025-01-22T09:21:34.638ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 505.735809ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
13212025-01-22T09:21:34.656ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 143.652709ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
13222025-01-22T09:21:34.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 1.035982038s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
13232025-01-22T09:21:34.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 513.624797ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
13242025-01-22T09:21:34.748ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 907.394647ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
13252025-01-22T09:21:34.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 145.808127ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
13262025-01-22T09:21:34.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 543.859968ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
13272025-01-22T09:21:34.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 759.791794ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
13282025-01-22T09:21:34.967ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 455.325955ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
13292025-01-22T09:21:35.030ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 739.085137ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
13302025-01-22T09:21:35.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 1.11442724s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
13312025-01-22T09:21:35.225ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 786.086621ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
13322025-01-22T09:21:35.259ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 1.397363294s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
13332025-01-22T09:21:35.376ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 1.306623776s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
13342025-01-22T09:21:35.436ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 694.137697ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
13352025-01-22T09:21:35.555ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 1.254163221s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
13362025-01-22T09:21:35.569ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 1.121899874s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
13372025-01-22T09:21:35.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 682.219094ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
13382025-01-22T09:21:35.657ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13392025-01-22T09:21:35.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 1.405617787s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
13402025-01-22T09:21:35.666ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
13412025-01-22T09:21:35.694ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_b5aeeec4-0c1c-45d8-941a-82b993064243/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='9a98d08a-6a88-42a0-a6b5-d634c65ba775'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13422025-01-22T09:21:35.694ZINFOSledAgent (ServiceManager): Booting oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
13432025-01-22T09:21:35.719ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 1.279281016s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
13442025-01-22T09:21:35.743ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 867.98826ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
13452025-01-22T09:21:35.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 1.003418424s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
13462025-01-22T09:21:35.838ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 29.110531ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
13472025-01-22T09:21:35.848ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 39.775071ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
13482025-01-22T09:21:35.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 135.926058ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
13492025-01-22T09:21:35.896ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 54.486007ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
13502025-01-22T09:21:35.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 133.46056ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
13512025-01-22T09:21:36.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 165.036663ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
13522025-01-22T09:21:36.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 831.176335ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
13532025-01-22T09:21:36.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 416.896061ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
13542025-01-22T09:21:36.140ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 787.404158ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
13552025-01-22T09:21:36.196ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 327.54462ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
13562025-01-22T09:21:36.282ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 1.316467235s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
13572025-01-22T09:21:36.340ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 965.577937ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
13582025-01-22T09:21:36.531ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 947.201942ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
13592025-01-22T09:21:36.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 1.120605662s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
13602025-01-22T09:21:36.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 1.47920733s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
13612025-01-22T09:21:36.666ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 864.80301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
13622025-01-22T09:21:36.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 1.172029309s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
13632025-01-22T09:21:36.701ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 921.877446ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
13642025-01-22T09:21:36.713ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13652025-01-22T09:21:36.713ZINFOSledAgent (ServiceManager): Booting oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
13662025-01-22T09:21:36.794ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 1.194042723s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
13672025-01-22T09:21:36.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 1.394949378s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
13682025-01-22T09:21:36.873ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 1.145777963s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
13692025-01-22T09:21:36.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 72.847076ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
13702025-01-22T09:21:36.937ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 539.892643ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
13712025-01-22T09:21:36.972ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 108.516124ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
13722025-01-22T09:21:37.007ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 1.344535687s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
13732025-01-22T09:21:37.082ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 730.862055ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
13742025-01-22T09:21:37.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 163.016844ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
13752025-01-22T09:21:37.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 326.425263ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
13762025-01-22T09:21:37.315ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 1.324603589s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
13772025-01-22T09:21:37.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 839.543647ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
13782025-01-22T09:21:37.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 1.059023307s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
13792025-01-22T09:21:37.539ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 986.028463ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
13802025-01-22T09:21:37.602ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 643.017293ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
13812025-01-22T09:21:37.610ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 881.951643ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
13822025-01-22T09:21:37.648ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 1.260214731s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
13832025-01-22T09:21:37.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 943.244022ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
13842025-01-22T09:21:37.818ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 61.438702ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
13852025-01-22T09:21:37.828ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 1.35207179s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
13862025-01-22T09:21:37.836ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 33.808041ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
13872025-01-22T09:21:37.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 589.645836ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
13882025-01-22T09:21:37.884ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 131.246193ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
13892025-01-22T09:21:37.893ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 90.743361ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
13902025-01-22T09:21:37.996ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 258.236757ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
13912025-01-22T09:21:38.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 1.198553712s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
13922025-01-22T09:21:38.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 250.164785ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
13932025-01-22T09:21:38.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 532.831973ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
13942025-01-22T09:21:38.122ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 1.38398664s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
13952025-01-22T09:21:38.229ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 1.43351101s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
13962025-01-22T09:21:38.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 1.467587686s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
13972025-01-22T09:21:38.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 579.021152ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
13982025-01-22T09:21:38.299ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 569.912373ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
13992025-01-22T09:21:38.336ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 1.165732772s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
14002025-01-22T09:21:38.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 926.609438ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
14012025-01-22T09:21:38.478ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 1.203356769s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
14022025-01-22T09:21:38.479ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14032025-01-22T09:21:38.479ZINFOSledAgent (ServiceManager): Booting oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14042025-01-22T09:21:38.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 1.427664692s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
14052025-01-22T09:21:38.536ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 1.0655433s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
14062025-01-22T09:21:38.564ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 1.480746259s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
14072025-01-22T09:21:38.586ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 594.573654ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
14082025-01-22T09:21:38.625ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 1.427213983s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
14092025-01-22T09:21:38.650ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 1.093513461s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
14102025-01-22T09:21:38.660ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 48.581001ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14112025-01-22T09:21:38.721ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 58.37521ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14122025-01-22T09:21:38.789ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 197.445632ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14132025-01-22T09:21:38.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 1.08650334s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
14142025-01-22T09:21:38.880ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 1.10409616s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
14152025-01-22T09:21:38.917ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 1.280263644s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
14162025-01-22T09:21:38.997ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 286.335939ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14172025-01-22T09:21:39.192ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 1.165410007s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
14182025-01-22T09:21:39.201ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 1.124101436s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
14192025-01-22T09:21:39.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 1.214789338s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
14202025-01-22T09:21:39.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 777.655475ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14212025-01-22T09:21:39.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 1.203656127s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
14222025-01-22T09:21:39.446ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52168
14232025-01-22T09:21:39.463ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 11349 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52168 req_id = 44e1bdb1-9dc5-4396-8b4f-cff73088dd8f response_code = 200 uri = /baseboard
14242025-01-22T09:21:39.512ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 518.849407ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
14252025-01-22T09:21:39.522ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 630.081413ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
14262025-01-22T09:21:39.611ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 672.635824ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
14272025-01-22T09:21:39.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 1.321819614s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
14282025-01-22T09:21:39.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 1.170015064s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
14292025-01-22T09:21:39.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 573.829499ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
14302025-01-22T09:21:39.752ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 1.250510142s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
14312025-01-22T09:21:39.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 710.009369ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
14322025-01-22T09:21:39.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 1.190870307s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
14332025-01-22T09:21:39.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 1.128602561s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
14342025-01-22T09:21:40.040ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 965.123813ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
14352025-01-22T09:21:40.055ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 1.371424359s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
14362025-01-22T09:21:40.064ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 1.029411329s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
14372025-01-22T09:21:40.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 1.004688195s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14382025-01-22T09:21:40.161ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 1.12099761s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
14392025-01-22T09:21:40.207ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 941.12964ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
14402025-01-22T09:21:40.292ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 1.407877366s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
14412025-01-22T09:21:40.317ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 894.264146ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
14422025-01-22T09:21:40.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 769.122332ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
14432025-01-22T09:21:40.366ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 1.486309074s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
14442025-01-22T09:21:40.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 1.011844851s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
14452025-01-22T09:21:40.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 731.915969ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
14462025-01-22T09:21:40.662ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 1.111331596s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
14472025-01-22T09:21:40.871ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 898.523529ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
14482025-01-22T09:21:41.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 849.36026ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
14492025-01-22T09:21:41.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 1.190292184s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
14502025-01-22T09:21:41.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 927.795187ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
14512025-01-22T09:21:41.096ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 1.21962262s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14522025-01-22T09:21:41.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 771.439307ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
14532025-01-22T09:21:41.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 504.992684ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
14542025-01-22T09:21:41.133ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 772.443705ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
14552025-01-22T09:21:41.160ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 924.935119ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
14562025-01-22T09:21:41.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 877.454223ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
14572025-01-22T09:21:41.222ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 1.399199612s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
14582025-01-22T09:21:41.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 1.473635644s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
14592025-01-22T09:21:41.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 956.967406ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
14602025-01-22T09:21:41.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 1.403760403s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
14612025-01-22T09:21:41.481ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 775.094572ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
14622025-01-22T09:21:41.631ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 1.031101977s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
14632025-01-22T09:21:41.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 595.374216ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
14642025-01-22T09:21:41.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 1.460077657s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
14652025-01-22T09:21:41.793ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 1.031796981s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
14662025-01-22T09:21:41.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 981.980717ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
14672025-01-22T09:21:41.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 685.232518ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
14682025-01-22T09:21:41.889ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 1.261665116s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
14692025-01-22T09:21:41.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 1.209148832s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
14702025-01-22T09:21:41.960ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 545.540103ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
14712025-01-22T09:21:42.063ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 614.100278ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
14722025-01-22T09:21:42.097ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 680.414538ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
14732025-01-22T09:21:42.215ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 540.228841ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
14742025-01-22T09:21:42.264ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 1.450086171s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
14752025-01-22T09:21:42.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 1.04287197s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
14762025-01-22T09:21:42.323ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 1.347709714s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
14772025-01-22T09:21:42.337ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 941.626093ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14782025-01-22T09:21:42.521ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 952.058041ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
14792025-01-22T09:21:42.581ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 504.015569ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
14802025-01-22T09:21:42.634ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 834.805466ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
14812025-01-22T09:21:42.675ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 575.901892ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
14822025-01-22T09:21:42.691ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 1.37077191s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
14832025-01-22T09:21:42.751ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 662.379851ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
14842025-01-22T09:21:42.769ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 615.335203ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
14852025-01-22T09:21:42.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 1.339523737s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
14862025-01-22T09:21:42.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 1.427031612s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
14872025-01-22T09:21:42.854ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 910.202687ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
14882025-01-22T09:21:42.867ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 973.372046ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
14892025-01-22T09:21:43.102ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 1.493831869s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
14902025-01-22T09:21:43.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 845.325638ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
14912025-01-22T09:21:43.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 1.228440121s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
14922025-01-22T09:21:43.257ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 602.996993ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
14932025-01-22T09:21:43.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 1.324139485s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
14942025-01-22T09:21:43.295ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 676.507264ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
14952025-01-22T09:21:43.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 508.847819ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
14962025-01-22T09:21:43.400ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 1.405616302s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
14972025-01-22T09:21:43.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 1.278420111s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
14982025-01-22T09:21:43.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 1.437101981s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
14992025-01-22T09:21:43.505ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 829.854553ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
15002025-01-22T09:21:43.576ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15012025-01-22T09:21:43.576ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
15022025-01-22T09:21:43.686ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 619.716772ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
15032025-01-22T09:21:43.732ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 1.42090893s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
15042025-01-22T09:21:43.783ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 1.277414065s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
15052025-01-22T09:21:43.845ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 32.851386ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
15062025-01-22T09:21:43.864ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 1.08420368s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
15072025-01-22T09:21:43.881ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 746.170295ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
15082025-01-22T09:21:43.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 955.127748ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
15092025-01-22T09:21:43.911ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 94.970909ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
15102025-01-22T09:21:44.174ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 1.273001939s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
15112025-01-22T09:21:44.301ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 1.160438744s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
15122025-01-22T09:21:44.314ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 1.274890688s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
15132025-01-22T09:21:44.328ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 899.807466ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
15142025-01-22T09:21:44.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 108.939959ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
15152025-01-22T09:21:44.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 1.432500374s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
15162025-01-22T09:21:44.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 710.238161ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
15172025-01-22T09:21:44.379ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 611.872162ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
15182025-01-22T09:21:44.408ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 1.04283469s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
15192025-01-22T09:21:44.461ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 349.211469ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
15202025-01-22T09:21:44.607ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 526.384432ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
15212025-01-22T09:21:44.616ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 546.634216ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
15222025-01-22T09:21:44.637ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 1.461620898s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
15232025-01-22T09:21:44.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 1.198760616s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
15242025-01-22T09:21:44.816ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 1.108611026s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
15252025-01-22T09:21:44.827ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 745.583105ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
15262025-01-22T09:21:44.865ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 1.41469122s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
15272025-01-22T09:21:44.938ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 1.467447012s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
15282025-01-22T09:21:44.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 1.28098485s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
15292025-01-22T09:21:45.004ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 904.418533ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
15302025-01-22T09:21:45.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 1.370825895s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
15312025-01-22T09:21:45.086ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 547.294131ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
15322025-01-22T09:21:45.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 1.43831782s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
15332025-01-22T09:21:45.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 781.843893ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
15342025-01-22T09:21:45.177ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 710.998927ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
15352025-01-22T09:21:45.241ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 861.674095ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
15362025-01-22T09:21:45.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 803.917991ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
15372025-01-22T09:21:45.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 1.338769985s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
15382025-01-22T09:21:45.476ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 1.416920441s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
15392025-01-22T09:21:45.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 1.207772023s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
15402025-01-22T09:21:45.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 1.375594879s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
15412025-01-22T09:21:45.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 675.930733ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
15422025-01-22T09:21:45.795ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 895.049076ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
15432025-01-22T09:21:45.900ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 1.48494759s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
15442025-01-22T09:21:45.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 989.805274ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
15452025-01-22T09:21:45.926ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 1.410342494s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
15462025-01-22T09:21:45.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 561.030933ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
15472025-01-22T09:21:45.961ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 1.33423415s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
15482025-01-22T09:21:46.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 1.388556963s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
15492025-01-22T09:21:46.121ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 500.783506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
15502025-01-22T09:21:46.263ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 1.070758135s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
15512025-01-22T09:21:46.284ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 721.328279ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
15522025-01-22T09:21:46.302ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 1.296040029s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
15532025-01-22T09:21:46.339ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 932.652152ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
15542025-01-22T09:21:46.419ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 1.064211911s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
15552025-01-22T09:21:46.460ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 622.483397ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
15562025-01-22T09:21:46.513ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 1.343216851s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
15572025-01-22T09:21:46.601ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 1.251984647s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
15582025-01-22T09:21:46.636ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 938.760811ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
15592025-01-22T09:21:46.707ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 1.222743913s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
15602025-01-22T09:21:46.805ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 847.902404ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
15612025-01-22T09:21:46.820ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 715.40877ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
15622025-01-22T09:21:46.912ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 968.020398ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
15632025-01-22T09:21:46.929ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 967.654687ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
15642025-01-22T09:21:46.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 1.357332037s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
15652025-01-22T09:21:47.020ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 1.23209353s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
15662025-01-22T09:21:47.098ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 1.490640336s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
15672025-01-22T09:21:47.287ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 789.524139ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
15682025-01-22T09:21:47.313ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 903.549731ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
15692025-01-22T09:21:47.352ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 1.209011448s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
15702025-01-22T09:21:47.370ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 934.065548ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
15712025-01-22T09:21:47.402ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 1.329044596s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
15722025-01-22T09:21:47.498ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 967.429813ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
15732025-01-22T09:21:47.516ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 730.897603ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
15742025-01-22T09:21:47.553ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 1.129444514s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
15752025-01-22T09:21:47.597ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 962.16579ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
15762025-01-22T09:21:47.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 781.38637ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
15772025-01-22T09:21:47.673ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 1.45680886s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
15782025-01-22T09:21:47.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 709.858388ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
15792025-01-22T09:21:47.887ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 867.011607ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
15802025-01-22T09:21:47.901ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 595.198856ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
15812025-01-22T09:21:47.915ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965") failed: Property not found. retry in 1.417356609s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
15822025-01-22T09:21:47.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 1.44297624s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
15832025-01-22T09:21:48.095ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 930.881373ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
15842025-01-22T09:21:48.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa") failed: Property not found. retry in 1.489808031s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
15852025-01-22T09:21:48.268ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 878.51755ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
15862025-01-22T09:21:48.285ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 948.16362ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
15872025-01-22T09:21:48.327ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 1.37776102s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
15882025-01-22T09:21:48.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 839.002553ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
15892025-01-22T09:21:48.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630") failed: Property not found. retry in 980.187287ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
15902025-01-22T09:21:48.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 670.927305ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
15912025-01-22T09:21:48.509ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 1.167634565s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
15922025-01-22T09:21:48.572ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4") failed: Property not found. retry in 1.2990189s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
15932025-01-22T09:21:48.584ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 649.863109ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
15942025-01-22T09:21:48.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 858.393804ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
15952025-01-22T09:21:48.605ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 778.015113ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
15962025-01-22T09:21:48.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76") failed: Property not found. retry in 654.044996ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
15972025-01-22T09:21:48.747ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_8d313403-04e5-42ba-830f-69162af01437") failed: Property not found. retry in 1.091451822s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
15982025-01-22T09:21:48.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a") failed: Property not found. retry in 1.110529141s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
15992025-01-22T09:21:49.039ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad") failed: Property not found. retry in 1.109143001s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
16002025-01-22T09:21:49.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 954.943884ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
16012025-01-22T09:21:49.159ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 548.969964ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
16022025-01-22T09:21:49.173ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df") failed: Property not found. retry in 1.091282914s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
16032025-01-22T09:21:49.221ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a") failed: Property not found. retry in 1.457465488s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
16042025-01-22T09:21:49.248ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598") failed: Property not found. retry in 829.976341ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
16052025-01-22T09:21:49.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77") failed: Property not found. retry in 1.381819001s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
16062025-01-22T09:21:49.396ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd") failed: Property not found. retry in 939.711038ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
16072025-01-22T09:21:49.426ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_f355370f-27f8-480f-a075-c338511729ae") failed: Property not found. retry in 1.099699095s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
16082025-01-22T09:21:49.468ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0") failed: Property not found. retry in 873.12857ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
16092025-01-22T09:21:49.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf") failed: Property not found. retry in 1.07576517s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
16102025-01-22T09:21:49.730ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b") failed: Property not found. retry in 925.129457ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
16112025-01-22T09:21:49.750ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb") failed: Property not found. retry in 685.247296ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
16122025-01-22T09:21:49.800ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 5.811011278s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
16132025-01-22T09:21:50.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 566.349955ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
16142025-01-22T09:21:50.949ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 915.110872ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
16152025-01-22T09:21:51.883ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 935.587206ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
16162025-01-22T09:21:52.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 592.607267ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
16172025-01-22T09:21:53.437ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 1.037507983s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
16182025-01-22T09:21:54.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa") failed: Property not found. retry in 609.623686ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
16192025-01-22T09:21:55.124ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_15ee210a-dadf-4d23-a47a-a8053915b9bf
16202025-01-22T09:21:55.124ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_8cc5eb46-08bb-4d00-8d2e-18a0e40c58df
16212025-01-22T09:21:55.124ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_48eb66d5-ce02-46fd-9e84-bba4f177e630
16222025-01-22T09:21:55.124ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_03ec9fe8-b35c-4cd1-9c62-4c423c171b76
16232025-01-22T09:21:55.124ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_74c471b2-5b31-4348-9d86-0d0bd8adf26a
16242025-01-22T09:21:55.124ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_34f00e5a-5f0c-4095-9441-c6a39fae032b
16252025-01-22T09:21:55.124ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_1a041bed-d5dd-477f-a120-7e8d3b3cddb4
16262025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_2f493885-1d8e-4f10-aa89-9f2b6aebd598
16272025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_acd25015-8676-47ab-894b-39c025f1c2fa
16282025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_53359eef-0654-46e2-9b84-03f87b50bfa0
16292025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_f355370f-27f8-480f-a075-c338511729ae
16302025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_afc461c5-5a34-4bdf-8818-07fb287a6a77
16312025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_233783c1-a48b-4789-8fa4-09858248c7dd
16322025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_449b861e-6ed7-4b1c-977f-0b4cf34059bb
16332025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_1e7932d1-229e-464e-8be0-d00436be71ad
16342025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_760efec7-e305-4d29-8d53-203649569f4a
16352025-01-22T09:21:55.125ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_0dd41a65-6ea3-470b-8245-29da2ae7befa
16362025-01-22T09:21:55.129ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_8d313403-04e5-42ba-830f-69162af01437
16372025-01-22T09:21:55.129ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_46cfad4e-b1a4-47c4-969c-bd50f68e0965
16382025-01-22T09:21:55.131ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16392025-01-22T09:21:55.134ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16402025-01-22T09:21:55.137ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38082836 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:59925 req_id = 763e3143-ecb3-437f-9a71-bab67f0f13ec response_code = 204 uri = /omicron-zones
16412025-01-22T09:21:55.144ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16422025-01-22T09:21:55.154ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16432025-01-22T09:21:55.156ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::c]:12221 file = sled-agent/src/rack_setup/service.rs:803
16442025-01-22T09:21:55.188ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
16452025-01-22T09:21:55.192ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/fceadc01-7eef-448b-b630-a0fcde156219/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16462025-01-22T09:21:55.298ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/fceadc01-7eef-448b-b630-a0fcde156219/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16472025-01-22T09:21:55.405ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/fceadc01-7eef-448b-b630-a0fcde156219/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16482025-01-22T09:21:55.573ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/fceadc01-7eef-448b-b630-a0fcde156219/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16492025-01-22T09:21:55.644ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.776493012s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
16502025-01-22T09:21:55.833ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/fceadc01-7eef-448b-b630-a0fcde156219/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16512025-01-22T09:21:56.098ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/fceadc01-7eef-448b-b630-a0fcde156219/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16522025-01-22T09:21:56.305ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/fceadc01-7eef-448b-b630-a0fcde156219/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16532025-01-22T09:21:56.604ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/fceadc01-7eef-448b-b630-a0fcde156219/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16542025-01-22T09:21:56.928ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::c]:12221/racks/fceadc01-7eef-448b-b630-a0fcde156219/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16552025-01-22T09:21:57.523ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "4cc025e0-7444-4603-8e7d-9dec3b586a32", "content-length": "173", "date": "Wed, 22 Jan 2025 09:21:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"fceadc01-7eef-448b-b630-a0fcde156219\"", request_id: "4cc025e0-7444-4603-8e7d-9dec3b586a32" } file = sled-agent/src/rack_setup/service.rs:1079
16562025-01-22T09:21:57.894ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "3ef5f4c9-0fdd-48ea-8c3b-f48e12f099cc", "content-length": "173", "date": "Wed, 22 Jan 2025 09:21:57 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"fceadc01-7eef-448b-b630-a0fcde156219\"", request_id: "3ef5f4c9-0fdd-48ea-8c3b-f48e12f099cc" } file = sled-agent/src/rack_setup/service.rs:1079
16572025-01-22T09:21:58.553ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "444f7327-0f6d-4a52-b450-ce30fbea8601", "content-length": "173", "date": "Wed, 22 Jan 2025 09:21:58 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"fceadc01-7eef-448b-b630-a0fcde156219\"", request_id: "444f7327-0f6d-4a52-b450-ce30fbea8601" } file = sled-agent/src/rack_setup/service.rs:1079
16582025-01-22T09:21:59.599ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "738a8889-b6c6-4743-b325-eda2349b5bc5", "content-length": "173", "date": "Wed, 22 Jan 2025 09:21:59 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"fceadc01-7eef-448b-b630-a0fcde156219\"", request_id: "738a8889-b6c6-4743-b325-eda2349b5bc5" } file = sled-agent/src/rack_setup/service.rs:1079
16592025-01-22T09:22:01.871ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a4edf595-fb55-4b68-8272-e27409be5f67", "content-length": "173", "date": "Wed, 22 Jan 2025 09:22:01 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"02eb3679-08e1-4d9d-a221-e5b8fe419fb5\"", request_id: "a4edf595-fb55-4b68-8272-e27409be5f67" } file = sled-agent/src/rack_setup/service.rs:1079
16602025-01-22T09:22:03.305ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "7734412e-1ac0-4de3-ad30-14bc96405b6b", "content-length": "173", "date": "Wed, 22 Jan 2025 09:22:03 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"02eb3679-08e1-4d9d-a221-e5b8fe419fb5\"", request_id: "7734412e-1ac0-4de3-ad30-14bc96405b6b" } file = sled-agent/src/rack_setup/service.rs:1079
16612025-01-22T09:22:05.892ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "a31daa1c-f7bb-440c-96e5-71eb53c2a180", "content-length": "173", "date": "Wed, 22 Jan 2025 09:22:05 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"02eb3679-08e1-4d9d-a221-e5b8fe419fb5\"", request_id: "a31daa1c-f7bb-440c-96e5-71eb53c2a180" } file = sled-agent/src/rack_setup/service.rs:1079
16622025-01-22T09:22:07.504ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 22.483946137s error = "Error Response: status: 503 Service Unavailable; headers: {\\"content-type\\": \\"application/json\\", \\"x-request-id\\": \\"b00e419e-8d92-45fc-86f8-f405d5b08137\\", \\"content-length\\": \\"133\\", \\"date\\": \\"Wed, 22 Jan 2025 09:22:07 GMT\\"}; value: Error { error_code: Some(\\"ServiceNotAvailable\\"), message: \\"Service Unavailable\\", request_id: \\"b00e419e-8d92-45fc-86f8-f405d5b08137\\" }" file = oximeter/producer/src/lib.rs:420 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
16632025-01-22T09:22:07.778ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "8dc8769c-20bb-43c4-b693-15a0ed4955d5", "content-length": "173", "date": "Wed, 22 Jan 2025 09:22:07 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"02eb3679-08e1-4d9d-a221-e5b8fe419fb5\"", request_id: "8dc8769c-20bb-43c4-b693-15a0ed4955d5" } file = sled-agent/src/rack_setup/service.rs:1079
16642025-01-22T09:22:09.500ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:53553
16652025-01-22T09:22:09.505ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:53553 req_id = 3a5421b3-13eb-4ed2-b8df-c4c3718298e0 response_code = 200 uri = /baseboard
16662025-01-22T09:22:10.112ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "6006c50c-d2fa-40ec-8715-d5125f9d1cf4", "content-length": "173", "date": "Wed, 22 Jan 2025 09:22:09 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"02eb3679-08e1-4d9d-a221-e5b8fe419fb5\"", request_id: "6006c50c-d2fa-40ec-8715-d5125f9d1cf4" } file = sled-agent/src/rack_setup/service.rs:1079
16672025-01-22T09:22:12.776ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "cae1d26d-a515-4a3a-ae9c-d434380203c3", "content-length": "173", "date": "Wed, 22 Jan 2025 09:22:12 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"02eb3679-08e1-4d9d-a221-e5b8fe419fb5\"", request_id: "cae1d26d-a515-4a3a-ae9c-d434380203c3" } file = sled-agent/src/rack_setup/service.rs:1079
16682025-01-22T09:22:16.716ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "43cb07be-89a7-4194-8d48-09602f3e0431", "content-length": "173", "date": "Wed, 22 Jan 2025 09:22:16 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"02eb3679-08e1-4d9d-a221-e5b8fe419fb5\"", request_id: "43cb07be-89a7-4194-8d48-09602f3e0431" } file = sled-agent/src/rack_setup/service.rs:1079
16692025-01-22T09:22:19.869ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
16702025-01-22T09:22:19.969ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33585
16712025-01-22T09:22:19.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16722025-01-22T09:22:19.974ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
16732025-01-22T09:22:19.975ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:177
16742025-01-22T09:22:19.976ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:177
16752025-01-22T09:22:19.990ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16762025-01-22T09:22:19.991ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5aeeec4-0c1c-45d8-941a-82b993064243
16772025-01-22T09:22:20.017ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16782025-01-22T09:22:20.017ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_34031fe8-4691-4be6-a0d4-bb1591795113
16792025-01-22T09:22:20.043ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16802025-01-22T09:22:20.043ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3
16812025-01-22T09:22:20.069ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16822025-01-22T09:22:20.069ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38
16832025-01-22T09:22:20.094ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16842025-01-22T09:22:20.094ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750
16852025-01-22T09:22:20.118ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16862025-01-22T09:22:20.118ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbff868b-4199-4969-b27b-36834c92fe00
16872025-01-22T09:22:20.143ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16882025-01-22T09:22:20.143ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8
16892025-01-22T09:22:20.165ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16902025-01-22T09:22:20.165ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8
16912025-01-22T09:22:20.191ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
16922025-01-22T09:22:20.191ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dad37219-37a0-41c1-b1d5-db92f039358b
16932025-01-22T09:22:20.207ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 237544 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33585 req_id = ac33a528-8cde-40a3-8963-8a660276b04e response_code = 200 uri = /inventory
16942025-01-22T09:22:22.074ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60212
16952025-01-22T09:22:22.075ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
16962025-01-22T09:22:22.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16972025-01-22T09:22:22.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
16982025-01-22T09:22:22.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
16992025-01-22T09:22:22.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17002025-01-22T09:22:22.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17012025-01-22T09:22:22.075ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17022025-01-22T09:22:22.075ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1629 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60212 req_id = 5ce5d03d-4451-4c61-b186-3f0cda8900a8 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17032025-01-22T09:22:22.078ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
17042025-01-22T09:22:22.083ZINFOSledAgent (RSS): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17052025-01-22T09:22:22.083ZINFOSledAgent (RSS): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17062025-01-22T09:22:22.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44237
17072025-01-22T09:22:22.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17082025-01-22T09:22:22.474ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17092025-01-22T09:22:22.474ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:177
17102025-01-22T09:22:22.474ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:177
17112025-01-22T09:22:22.486ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17122025-01-22T09:22:22.486ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5aeeec4-0c1c-45d8-941a-82b993064243
17132025-01-22T09:22:22.514ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17142025-01-22T09:22:22.514ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_34031fe8-4691-4be6-a0d4-bb1591795113
17152025-01-22T09:22:22.537ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17162025-01-22T09:22:22.537ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3
17172025-01-22T09:22:22.561ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17182025-01-22T09:22:22.561ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38
17192025-01-22T09:22:22.584ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17202025-01-22T09:22:22.584ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750
17212025-01-22T09:22:22.606ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17222025-01-22T09:22:22.606ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbff868b-4199-4969-b27b-36834c92fe00
17232025-01-22T09:22:22.630ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17242025-01-22T09:22:22.630ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8
17252025-01-22T09:22:22.653ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17262025-01-22T09:22:22.653ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8
17272025-01-22T09:22:22.680ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17282025-01-22T09:22:22.680ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dad37219-37a0-41c1-b1d5-db92f039358b
17292025-01-22T09:22:22.696ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 222035 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44237 req_id = 335afb50-1cbf-4d87-a0f0-29b624fc7e3c response_code = 200 uri = /inventory
17302025-01-22T09:22:22.885ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44023
17312025-01-22T09:22:22.885ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17322025-01-22T09:22:22.885ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17332025-01-22T09:22:22.885ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17342025-01-22T09:22:22.885ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17352025-01-22T09:22:22.885ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17362025-01-22T09:22:22.885ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17372025-01-22T09:22:22.885ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17382025-01-22T09:22:22.885ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 350 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:44023 req_id = 2fcdbd45-c888-4534-bac2-44fcf06c6565 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17392025-01-22T09:22:22.901ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47836
17402025-01-22T09:22:22.902ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17412025-01-22T09:22:22.902ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17422025-01-22T09:22:22.902ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17432025-01-22T09:22:22.902ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17442025-01-22T09:22:22.902ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17452025-01-22T09:22:22.902ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17462025-01-22T09:22:22.902ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17472025-01-22T09:22:22.902ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47836 req_id = 4409af25-29d7-4943-a0af-fe4e01571f07 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17482025-01-22T09:22:23.545ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43042
17492025-01-22T09:22:23.545ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17502025-01-22T09:22:23.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17512025-01-22T09:22:23.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17522025-01-22T09:22:23.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17532025-01-22T09:22:23.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17542025-01-22T09:22:23.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17552025-01-22T09:22:23.545ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17562025-01-22T09:22:23.545ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 291 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43042 req_id = 3694df4c-484f-41f9-908e-b35224dda40b response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17572025-01-22T09:22:29.683ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55275
17582025-01-22T09:22:29.684ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 991 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55275 req_id = 6aed2fe9-105b-452b-a388-b83a986573d6 response_code = 200 uri = /vpc-routes
17592025-01-22T09:22:30.030ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
17602025-01-22T09:22:30.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 449 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55275 req_id = 8e713cef-d5f1-47e6-b65d-c0aba0c42a5f response_code = 204 uri = /eip-gateways
17612025-01-22T09:22:30.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63875
17622025-01-22T09:22:30.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 947 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63875 req_id = f420da7c-d885-42f0-bff9-bf5bef29b6c8 response_code = 200 uri = /v2p
17632025-01-22T09:22:30.148ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38020
17642025-01-22T09:22:30.148ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17652025-01-22T09:22:30.248ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17662025-01-22T09:22:30.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175504 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38020 req_id = a40af214-8a6a-4748-b61e-5f79a9300b41 response_code = 204 uri = /switch-ports
17672025-01-22T09:22:30.323ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41521
17682025-01-22T09:22:30.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41521 req_id = 0ce364ad-b66f-44da-bb02-9a3ca22879aa response_code = 200 uri = /vpc-routes
17692025-01-22T09:22:30.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1516 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38020 req_id = edc2a7a8-cf2c-4242-8e95-1c77d0ef1d06 response_code = 200 uri = /network-bootstore-config
17702025-01-22T09:22:30.395ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
17712025-01-22T09:22:30.396ZINFOSledAgent (bootstore): Writing ledger to /pool/int/42d2a693-a856-441a-b467-e7857d30832a/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17722025-01-22T09:22:30.397ZINFOSledAgent (bootstore): Writing ledger to /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
17732025-01-22T09:22:30.398ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
17742025-01-22T09:22:30.398ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3869 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38020 req_id = 9b77c633-9b81-4dca-b754-b17bfbcd65c0 response_code = 204 uri = /network-bootstore-config
17752025-01-22T09:22:30.403ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52408
17762025-01-22T09:22:30.403ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52408 req_id = 3dcaab4f-2115-433d-8bc3-ff5f04125462 response_code = 200 uri = /vpc-routes
17772025-01-22T09:22:30.442ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
17782025-01-22T09:22:30.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41521 req_id = d8295bea-038e-4c48-b582-ffe7993626fa response_code = 204 uri = /eip-gateways
17792025-01-22T09:22:30.457ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1930 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55275 req_id = 79ba6629-fa57-4ee0-99a6-4b668036fa47 response_code = 204 uri = /vpc-routes
17802025-01-22T09:22:30.474ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36100
17812025-01-22T09:22:30.474ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36100 req_id = e6fa0385-c55d-4711-abe2-233a36c7f690 response_code = 200 uri = /v2p
17822025-01-22T09:22:30.490ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33415
17832025-01-22T09:22:30.490ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17842025-01-22T09:22:30.536ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17852025-01-22T09:22:30.613ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122578 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:33415 req_id = 351ba9de-0014-4bec-a435-43164ac977e5 response_code = 204 uri = /switch-ports
17862025-01-22T09:22:30.613ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48796
17872025-01-22T09:22:30.613ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
17882025-01-22T09:22:30.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 215 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52408 req_id = 9dd6b1b9-614f-473c-ba7f-1b13098b0960 response_code = 204 uri = /eip-gateways
17892025-01-22T09:22:30.614ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
17902025-01-22T09:22:30.614ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33415 req_id = 2cae52be-950c-4f13-b2f8-ee6f2acfc0ec response_code = 200 uri = /network-bootstore-config
17912025-01-22T09:22:30.623ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
17922025-01-22T09:22:30.624ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41521 req_id = 872b4c04-44bc-40d4-b0a1-3f7d52637899 response_code = 204 uri = /vpc-routes
17932025-01-22T09:22:30.665ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
17942025-01-22T09:22:30.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122260 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48796 req_id = c8f162d9-f58c-4076-960e-f32de97427d9 response_code = 204 uri = /switch-ports
17952025-01-22T09:22:30.736ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48796 req_id = 07559e12-4e30-4581-ac72-e6be05dc2edb response_code = 200 uri = /network-bootstore-config
17962025-01-22T09:22:30.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:60215
17972025-01-22T09:22:30.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:60215 req_id = ca182c24-88c5-4e32-8e47-76644a3875b4 response_code = 200 uri = /vpc-routes
17982025-01-22T09:22:30.754ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
17992025-01-22T09:22:30.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60215 req_id = 6e18c705-5f17-4cf3-8f91-3c61c90f38a5 response_code = 204 uri = /eip-gateways
18002025-01-22T09:22:30.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44321
18012025-01-22T09:22:30.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44321 req_id = c89d9e50-001a-4829-9cc3-6718b647a043 response_code = 200 uri = /v2p
18022025-01-22T09:22:30.763ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:60215 req_id = f1f5e196-b02b-46e1-a027-c97499042adf response_code = 204 uri = /vpc-routes
18032025-01-22T09:22:30.804ZINFOSledAgent (PortManager): skipping delta compute for subnet file = illumos-utils/src/opte/port_manager.rs:486 new_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } old_vers = RouterVersion { router_id: 001de000-074c-4000-8000-000000000001, version: 4 } subnet = RouterId { vni: Vni(100), kind: System }
18042025-01-22T09:22:30.804ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 364 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52408 req_id = e97dd681-9573-4844-8c05-a21b70d5db34 response_code = 204 uri = /vpc-routes
18052025-01-22T09:22:39.543ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40703
18062025-01-22T09:22:39.544ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40703 req_id = b602563b-1558-4b9c-8139-87416bb5d052 response_code = 200 uri = /baseboard
18072025-01-22T09:22:59.761ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42656
18082025-01-22T09:22:59.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42656 req_id = d7f0108d-c470-4291-ab02-c758dca617e2 response_code = 200 uri = /vpc-routes
18092025-01-22T09:22:59.951ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
18102025-01-22T09:22:59.951ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42656 req_id = 73a32d4f-8b7f-4108-bb62-255b25622fdd response_code = 204 uri = /eip-gateways
18112025-01-22T09:22:59.960ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:42656 req_id = 11ebb8b4-253b-454b-8ebe-ae5ca1d4125c response_code = 204 uri = /vpc-routes
18122025-01-22T09:22:59.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52974
18132025-01-22T09:22:59.999ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18142025-01-22T09:23:00.045ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18152025-01-22T09:23:00.143ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144121 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:52974 req_id = 60eb24f5-e7dd-447d-ab59-9a77dcd15aa2 response_code = 204 uri = /switch-ports
18162025-01-22T09:23:00.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34771
18172025-01-22T09:23:00.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46146
18182025-01-22T09:23:00.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 340 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52974 req_id = 5716fc82-92c5-43c4-8eb4-b9c9aa985997 response_code = 200 uri = /network-bootstore-config
18192025-01-22T09:23:00.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46146 req_id = cd48a6e0-0654-4de3-a35b-b4e73962ac4f response_code = 200 uri = /v2p
18202025-01-22T09:23:00.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34771 req_id = b6cb5726-1617-4fef-80ad-51e5617f3cfa response_code = 200 uri = /vpc-routes
18212025-01-22T09:23:00.213ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48784
18222025-01-22T09:23:00.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48784 req_id = 3ebdf807-b466-46bd-97a0-e44b85ca97e4 response_code = 200 uri = /v2p
18232025-01-22T09:23:00.268ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
18242025-01-22T09:23:00.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34771 req_id = feeb1519-6dfa-44e0-bdba-799b90e3e768 response_code = 204 uri = /eip-gateways
18252025-01-22T09:23:00.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 347 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:34771 req_id = b83d9b8a-85b9-4a9d-856b-ee20e49e71ae response_code = 204 uri = /vpc-routes
18262025-01-22T09:23:00.285ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41844
18272025-01-22T09:23:00.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41844 req_id = 3eed4b19-6a06-4b67-b0ef-c8a2c7027dd6 response_code = 200 uri = /vpc-routes
18282025-01-22T09:23:00.354ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
18292025-01-22T09:23:00.354ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41844 req_id = e401a4d3-0640-4cfb-9983-a4fda2e1128b response_code = 204 uri = /eip-gateways
18302025-01-22T09:23:00.452ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60826
18312025-01-22T09:23:00.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60826 req_id = 7d6e94b5-f5e1-4370-ac49-041fcec95982 response_code = 200 uri = /v2p
18322025-01-22T09:23:00.462ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 208 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41844 req_id = a163fd81-690d-4a49-81e2-8d9cd606c3b7 response_code = 204 uri = /vpc-routes
18332025-01-22T09:23:00.470ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65060
18342025-01-22T09:23:00.471ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18352025-01-22T09:23:00.506ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18362025-01-22T09:23:00.570ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99853 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65060 req_id = 48d40059-2a56-4875-8f32-a5911900a2ea response_code = 204 uri = /switch-ports
18372025-01-22T09:23:00.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65060 req_id = 11ca562e-02c9-4f2c-a22a-b7fd3d88dc04 response_code = 200 uri = /network-bootstore-config
18382025-01-22T09:23:00.582ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46276
18392025-01-22T09:23:00.582ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18402025-01-22T09:23:00.620ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18412025-01-22T09:23:00.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91424 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46276 req_id = 7eeb1896-c5b1-4c3a-b7a1-b1dac9d1693a response_code = 204 uri = /switch-ports
18422025-01-22T09:23:00.674ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46276 req_id = 6279894a-4bf8-4d01-ad2e-2c02ad3a2eaa response_code = 200 uri = /network-bootstore-config
18432025-01-22T09:23:09.576ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39341
18442025-01-22T09:23:09.576ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39341 req_id = 9348e095-c134-4d17-b6fb-ed7270e392f9 response_code = 200 uri = /baseboard
18452025-01-22T09:23:10.548ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:34317 remote_addr = [fd00:1122:3344:101::d]:62315 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
18462025-01-22T09:23:10.583ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34770 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 881325ad-0e3d-42f6-8a30-0200b0675e62 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
18472025-01-22T09:23:29.786ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37364
18482025-01-22T09:23:29.786ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37364 req_id = b09bb233-63ed-4f5c-a213-955fc9f04116 response_code = 200 uri = /vpc-routes
18492025-01-22T09:23:29.808ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45344
18502025-01-22T09:23:29.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45344 req_id = 9ffec463-ab6c-4897-a41e-c385372f9b6b response_code = 200 uri = /v2p
18512025-01-22T09:23:29.822ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
18522025-01-22T09:23:29.822ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37364 req_id = 305f5246-4023-41f4-a68d-e5dc179c3405 response_code = 204 uri = /eip-gateways
18532025-01-22T09:23:29.833ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37364 req_id = 5d2bf27e-c020-43a6-bb6a-45178258776a response_code = 204 uri = /vpc-routes
18542025-01-22T09:23:29.897ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55812
18552025-01-22T09:23:29.897ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18562025-01-22T09:23:29.932ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18572025-01-22T09:23:29.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89117 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55812 req_id = 78053476-0020-49c8-b2bd-00f4375721c6 response_code = 204 uri = /switch-ports
18582025-01-22T09:23:29.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55812 req_id = eee5d2dd-5d3d-4cdf-b382-aea0feedb66f response_code = 200 uri = /network-bootstore-config
18592025-01-22T09:23:29.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46210
18602025-01-22T09:23:29.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46210 req_id = 29774380-8d4a-4cdf-8c92-8b153692e251 response_code = 200 uri = /vpc-routes
18612025-01-22T09:23:30.074ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
18622025-01-22T09:23:30.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 357 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46210 req_id = 05d4338b-2e17-4e72-8c03-e7c56f498dbb response_code = 204 uri = /eip-gateways
18632025-01-22T09:23:30.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46210 req_id = 024a91a3-a55e-463d-ba7d-c33a599191fb response_code = 204 uri = /vpc-routes
18642025-01-22T09:23:30.261ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65220
18652025-01-22T09:23:30.261ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65220 req_id = 840d2c94-e548-47eb-bb65-a453b0214248 response_code = 200 uri = /v2p
18662025-01-22T09:23:30.268ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55344
18672025-01-22T09:23:30.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 24 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55344 req_id = 3d292fcc-8147-43d8-a400-9e047d88d949 response_code = 200 uri = /vpc-routes
18682025-01-22T09:23:30.290ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53071
18692025-01-22T09:23:30.290ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18702025-01-22T09:23:30.329ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18712025-01-22T09:23:30.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95161 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:53071 req_id = bd7947d9-9c4a-430a-bbf7-1b7f41b2b573 response_code = 204 uri = /switch-ports
18722025-01-22T09:23:30.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60893
18732025-01-22T09:23:30.386ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
18742025-01-22T09:23:30.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55344 req_id = 6843ee0b-2cc2-4499-a1bb-aa6754da5a5b response_code = 204 uri = /eip-gateways
18752025-01-22T09:23:30.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53071 req_id = 294c2edd-a5d7-4eab-9a8b-48270d6d9940 response_code = 200 uri = /network-bootstore-config
18762025-01-22T09:23:30.386ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60893 req_id = 61f885f5-d43b-420a-a3d5-f46af31a0098 response_code = 200 uri = /v2p
18772025-01-22T09:23:30.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:55344 req_id = f804a1c4-06bd-4497-96da-2e4f12467b88 response_code = 204 uri = /vpc-routes
18782025-01-22T09:23:30.423ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40506
18792025-01-22T09:23:30.424ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18802025-01-22T09:23:30.463ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18812025-01-22T09:23:30.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104320 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40506 req_id = 76d32713-b0d5-4c24-bb34-a0bd77a6c8bd response_code = 204 uri = /switch-ports
18822025-01-22T09:23:30.528ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40506 req_id = 133adb01-ada4-4c7f-9525-3f37a46c9907 response_code = 200 uri = /network-bootstore-config
18832025-01-22T09:23:39.613ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60192
18842025-01-22T09:23:39.613ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60192 req_id = 6721a430-e9d6-4ef5-9ee4-9824f5dbd234 response_code = 200 uri = /baseboard
18852025-01-22T09:23:40.555ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7055 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 79701e29-54fe-4f8b-b20e-44b5b3a39770 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
18862025-01-22T09:23:59.873ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54055
18872025-01-22T09:23:59.873ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54055 req_id = a6a6204d-dabd-479b-82a1-339285471c2b response_code = 200 uri = /vpc-routes
18882025-01-22T09:23:59.901ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
18892025-01-22T09:23:59.901ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54055 req_id = 94fbcb82-794f-42db-9085-2d4887fec40c response_code = 204 uri = /eip-gateways
18902025-01-22T09:23:59.920ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54055 req_id = 47b87e13-4e76-4470-98bf-cfa77373822d response_code = 204 uri = /vpc-routes
18912025-01-22T09:24:00.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36297
18922025-01-22T09:24:00.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36297 req_id = 91bab88b-89bb-4471-bef4-5370da2025d9 response_code = 200 uri = /v2p
18932025-01-22T09:24:00.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33613
18942025-01-22T09:24:00.026ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18952025-01-22T09:24:00.083ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18962025-01-22T09:24:00.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 147913 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33613 req_id = 36217d36-a79a-4ddc-a697-70ba918b8284 response_code = 204 uri = /switch-ports
18972025-01-22T09:24:00.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33613 req_id = 7dd1ec36-c323-4b41-8bf7-163620c26407 response_code = 200 uri = /network-bootstore-config
18982025-01-22T09:24:00.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62411
18992025-01-22T09:24:00.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62411 req_id = e3c55ab1-86a0-4917-a622-2792b43d71f6 response_code = 200 uri = /vpc-routes
19002025-01-22T09:24:00.271ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
19012025-01-22T09:24:00.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62411 req_id = 04a5bea9-39f1-410c-b7b8-b738742e9761 response_code = 204 uri = /eip-gateways
19022025-01-22T09:24:00.281ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 289 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62411 req_id = 4c561aba-fbf8-43be-82ad-c2c2b4ab9c86 response_code = 204 uri = /vpc-routes
19032025-01-22T09:24:00.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33305
19042025-01-22T09:24:00.341ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33305 req_id = f6d8cd3e-092d-4eec-88d2-2b4c436bc67a response_code = 200 uri = /v2p
19052025-01-22T09:24:00.361ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48908
19062025-01-22T09:24:00.361ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19072025-01-22T09:24:00.397ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19082025-01-22T09:24:00.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92181 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48908 req_id = 495a169c-26ed-4981-aa3b-2bb3f6e94cdf response_code = 204 uri = /switch-ports
19092025-01-22T09:24:00.453ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58018
19102025-01-22T09:24:00.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 160 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48908 req_id = 18924721-8c1b-4b88-8c04-11204f66e922 response_code = 200 uri = /network-bootstore-config
19112025-01-22T09:24:00.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58018 req_id = 7067a40e-7b8b-4305-9902-74bfb688198d response_code = 200 uri = /vpc-routes
19122025-01-22T09:24:00.471ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
19132025-01-22T09:24:00.471ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58018 req_id = 9ed1aefa-6a4c-4a1d-979c-51b5ffeac8cd response_code = 204 uri = /eip-gateways
19142025-01-22T09:24:00.484ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58018 req_id = e000e355-c719-4988-90a8-37bcb21dc4c0 response_code = 204 uri = /vpc-routes
19152025-01-22T09:24:00.518ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35966
19162025-01-22T09:24:00.518ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19172025-01-22T09:24:00.560ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19182025-01-22T09:24:00.618ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100238 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35966 req_id = 0401e19c-18ae-432d-97e7-742481259912 response_code = 204 uri = /switch-ports
19192025-01-22T09:24:00.618ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63946
19202025-01-22T09:24:00.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35966 req_id = a70ded36-ae10-4759-9f42-74ab81aa4e2e response_code = 200 uri = /network-bootstore-config
19212025-01-22T09:24:00.619ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 205 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63946 req_id = 347d121b-a2ea-43b7-b13b-1bd6bd216738 response_code = 200 uri = /v2p
19222025-01-22T09:24:09.648ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35233
19232025-01-22T09:24:09.648ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35233 req_id = e43665c2-d82b-4ac3-beaa-b783f5f2a4e5 response_code = 200 uri = /baseboard
19242025-01-22T09:24:10.556ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7108 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = f224fa0d-d66c-4573-9ddf-cbe3170420ca response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
19252025-01-22T09:24:29.572ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64067
19262025-01-22T09:24:29.572ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64067 req_id = 645884a3-a20e-44a2-bb75-50509eaa2685 response_code = 200 uri = /vpc-routes
19272025-01-22T09:24:29.729ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49757
19282025-01-22T09:24:29.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49757 req_id = 19a7e4a8-3fa6-4820-bd01-ebc9e90de59a response_code = 200 uri = /v2p
19292025-01-22T09:24:29.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33640
19302025-01-22T09:24:29.743ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19312025-01-22T09:24:29.784ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19322025-01-22T09:24:29.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119174 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33640 req_id = b4e591c3-9c3a-432a-ba48-aace1acc73bf response_code = 204 uri = /switch-ports
19332025-01-22T09:24:29.862ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
19342025-01-22T09:24:29.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64067 req_id = d34c6021-632d-4dee-8697-a42586b2f70b response_code = 204 uri = /eip-gateways
19352025-01-22T09:24:29.863ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33640 req_id = 241a83d2-c4c1-49d1-91a8-e16bbde7f7f9 response_code = 200 uri = /network-bootstore-config
19362025-01-22T09:24:29.875ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64067 req_id = c36134dc-887c-4dc5-977d-404b93c5afe0 response_code = 204 uri = /vpc-routes
19372025-01-22T09:24:30.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35332
19382025-01-22T09:24:30.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35332 req_id = 3e44f541-c425-47c2-9558-4bb0b3a40b03 response_code = 200 uri = /vpc-routes
19392025-01-22T09:24:30.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
19402025-01-22T09:24:30.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35332 req_id = d1eca52c-9ad5-4561-a310-31f4be033106 response_code = 204 uri = /eip-gateways
19412025-01-22T09:24:30.157ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57615
19422025-01-22T09:24:30.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57615 req_id = 440e553d-0920-404e-ba33-ebb437d238aa response_code = 200 uri = /v2p
19432025-01-22T09:24:30.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35332 req_id = 029dc574-cd6d-473f-ac47-5c048066de3e response_code = 204 uri = /vpc-routes
19442025-01-22T09:24:30.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45307
19452025-01-22T09:24:30.193ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19462025-01-22T09:24:30.229ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19472025-01-22T09:24:30.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93606 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45307 req_id = fa9b8952-e99c-4bb7-bdd4-8735485791d9 response_code = 204 uri = /switch-ports
19482025-01-22T09:24:30.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36585
19492025-01-22T09:24:30.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39486
19502025-01-22T09:24:30.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45307 req_id = bfaa7156-bd83-454d-9885-8aabc02da6f6 response_code = 200 uri = /network-bootstore-config
19512025-01-22T09:24:30.287ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40073
19522025-01-22T09:24:30.287ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36585 req_id = 0ab17ee5-e3fc-49b4-aac3-68ee6d0cc3cf response_code = 200 uri = /vpc-routes
19532025-01-22T09:24:30.287ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19542025-01-22T09:24:30.293ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5005 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40073 req_id = f6807726-265d-42f4-a9ee-0fea953ecfb4 response_code = 200 uri = /v2p
19552025-01-22T09:24:30.325ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19562025-01-22T09:24:30.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95262 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39486 req_id = ef24ad5b-bc9c-4ba1-9161-6f7a32d9fb47 response_code = 204 uri = /switch-ports
19572025-01-22T09:24:30.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39486 req_id = a4387194-9055-4643-96ca-4b2d62fa6869 response_code = 200 uri = /network-bootstore-config
19582025-01-22T09:24:30.400ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
19592025-01-22T09:24:30.400ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36585 req_id = 782e0c6c-73f9-4513-aac8-d4242d7e814e response_code = 204 uri = /eip-gateways
19602025-01-22T09:24:30.408ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36585 req_id = 4b7f1880-fce2-405d-b162-30420b80116a response_code = 204 uri = /vpc-routes
19612025-01-22T09:24:39.685ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56277
19622025-01-22T09:24:39.685ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56277 req_id = 550ded99-c43c-4eea-a0b9-5616c602cb00 response_code = 200 uri = /baseboard
19632025-01-22T09:24:40.558ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7761 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 9a1f51c4-f442-4dd2-b00b-4de1c0d692a2 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
19642025-01-22T09:24:48.104ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19652025-01-22T09:24:59.762ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58261
19662025-01-22T09:24:59.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58261 req_id = 98f27220-9382-42eb-bdd6-445b6c0f5acb response_code = 200 uri = /vpc-routes
19672025-01-22T09:24:59.795ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35133
19682025-01-22T09:24:59.796ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35133 req_id = 244264a6-8e88-4161-b7e3-dc5be257789b response_code = 200 uri = /v2p
19692025-01-22T09:24:59.917ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
19702025-01-22T09:24:59.917ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58261 req_id = a2e65e6e-096a-413e-b6ed-4f6d98e061ee response_code = 204 uri = /eip-gateways
19712025-01-22T09:24:59.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 233 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58261 req_id = dfa84e47-7e0c-431e-a222-72a30325d080 response_code = 204 uri = /vpc-routes
19722025-01-22T09:25:00.214ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61969
19732025-01-22T09:25:00.214ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61969 req_id = 893b3019-a289-49b3-95c3-022dc2248f47 response_code = 200 uri = /vpc-routes
19742025-01-22T09:25:00.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52599
19752025-01-22T09:25:00.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52599 req_id = 5da2ae56-174c-4adc-b607-3c9df608c3e5 response_code = 200 uri = /v2p
19762025-01-22T09:25:00.241ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33850
19772025-01-22T09:25:00.241ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19782025-01-22T09:25:00.284ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19792025-01-22T09:25:00.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97053 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:33850 req_id = 74ae66a4-be28-4962-880f-a1edae17dad1 response_code = 204 uri = /switch-ports
19802025-01-22T09:25:00.338ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
19812025-01-22T09:25:00.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 336 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61969 req_id = 1aba7862-58c7-4ceb-98a7-17eb6f6f8ad4 response_code = 204 uri = /eip-gateways
19822025-01-22T09:25:00.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 373 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33850 req_id = 26d088e3-1f40-4f01-b0b0-ca84718361a6 response_code = 200 uri = /network-bootstore-config
19832025-01-22T09:25:00.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61969 req_id = 966c9d31-a4bb-4d6c-ab70-bda4185868bb response_code = 204 uri = /vpc-routes
19842025-01-22T09:25:00.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33138
19852025-01-22T09:25:00.436ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33138 req_id = be1ec03c-26dc-4616-aa48-7b896b14936b response_code = 200 uri = /vpc-routes
19862025-01-22T09:25:00.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54072
19872025-01-22T09:25:00.441ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19882025-01-22T09:25:00.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19892025-01-22T09:25:00.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94965 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54072 req_id = 50f00756-0a6f-4b41-80ed-9fb361465fc3 response_code = 204 uri = /switch-ports
19902025-01-22T09:25:00.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 229 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54072 req_id = 583c3b2e-0c42-4a56-b8ae-bfe74fddefa4 response_code = 200 uri = /network-bootstore-config
19912025-01-22T09:25:00.537ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
19922025-01-22T09:25:00.537ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33138 req_id = 8a8a517e-9bb9-41e7-adc2-494ca5bcd7e0 response_code = 204 uri = /eip-gateways
19932025-01-22T09:25:00.584ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52745
19942025-01-22T09:25:00.584ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52745 req_id = e826eacf-7e03-40d0-a173-7b5239958afd response_code = 200 uri = /v2p
19952025-01-22T09:25:00.593ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33138 req_id = fc77c61b-cf55-4a89-ac1e-267ef4b8b0cd response_code = 204 uri = /vpc-routes
19962025-01-22T09:25:00.608ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47320
19972025-01-22T09:25:00.608ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19982025-01-22T09:25:00.645ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19992025-01-22T09:25:00.700ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47320 req_id = 9566a02d-d8a9-46c6-9a6a-04a69e5cb351 response_code = 204 uri = /switch-ports
20002025-01-22T09:25:00.704ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47320 req_id = 4a241fef-81c3-4f38-84dc-d72f84d9c1f5 response_code = 200 uri = /network-bootstore-config
20012025-01-22T09:25:09.718ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44891
20022025-01-22T09:25:09.718ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44891 req_id = 13725ec0-31a6-4fb3-9121-22c423763860 response_code = 200 uri = /baseboard
20032025-01-22T09:25:10.557ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7109 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = ea02570b-31e8-4a0a-86ec-128fc179302d response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
20042025-01-22T09:25:29.664ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55390
20052025-01-22T09:25:29.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55390 req_id = d006add4-5e81-4932-9f29-141fe3f9d639 response_code = 200 uri = /vpc-routes
20062025-01-22T09:25:29.743ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59978
20072025-01-22T09:25:29.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59978 req_id = 6c65fec4-9207-4e6a-8492-97254c643520 response_code = 200 uri = /v2p
20082025-01-22T09:25:29.809ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
20092025-01-22T09:25:29.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55390 req_id = 671c2f94-bf28-46a8-ace0-1d5ec4d490cd response_code = 204 uri = /eip-gateways
20102025-01-22T09:25:29.819ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55390 req_id = a5be8291-65f1-454c-8587-9b8134f32b62 response_code = 204 uri = /vpc-routes
20112025-01-22T09:25:29.838ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65056
20122025-01-22T09:25:29.838ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20132025-01-22T09:25:29.892ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20142025-01-22T09:25:29.954ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65056 req_id = 7e25ffb4-a291-4c88-9151-05e81ca35778 response_code = 204 uri = /switch-ports
20152025-01-22T09:25:29.955ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 256 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65056 req_id = eb960d04-824b-4baa-bb50-877ff941a503 response_code = 200 uri = /network-bootstore-config
20162025-01-22T09:25:29.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42712
20172025-01-22T09:25:29.996ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42712 req_id = 449c3141-77a1-45f2-b404-4c5a40d5df83 response_code = 200 uri = /vpc-routes
20182025-01-22T09:25:30.053ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
20192025-01-22T09:25:30.053ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42712 req_id = 1501181e-514a-40b5-9222-67beb1cb8932 response_code = 204 uri = /eip-gateways
20202025-01-22T09:25:30.062ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42712 req_id = 7add3dfd-fabb-46ed-b85f-928111411066 response_code = 204 uri = /vpc-routes
20212025-01-22T09:25:30.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59684
20222025-01-22T09:25:30.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59684 req_id = cfa687cd-aa5a-4a3b-a265-6ed5732e8349 response_code = 200 uri = /v2p
20232025-01-22T09:25:30.194ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37891
20242025-01-22T09:25:30.194ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20252025-01-22T09:25:30.232ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20262025-01-22T09:25:30.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102406 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37891 req_id = 4b0a1089-cd00-46f7-b4de-4a585b83467c response_code = 204 uri = /switch-ports
20272025-01-22T09:25:30.297ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33646
20282025-01-22T09:25:30.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33646 req_id = 46af6197-8f00-4da5-a0e7-41b7e2b0c21f response_code = 200 uri = /vpc-routes
20292025-01-22T09:25:30.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37891 req_id = 4423fa59-3635-4bf8-ac69-cdf68b2bf515 response_code = 200 uri = /network-bootstore-config
20302025-01-22T09:25:30.312ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
20312025-01-22T09:25:30.312ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 67 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33646 req_id = 86e4ec20-4842-4965-b2b0-38fcb1c1b48e response_code = 204 uri = /eip-gateways
20322025-01-22T09:25:30.321ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33646 req_id = 5f9f6cd8-a711-466c-8e90-73a598c8e05a response_code = 204 uri = /vpc-routes
20332025-01-22T09:25:30.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42965
20342025-01-22T09:25:30.389ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42965 req_id = a87fcb80-7671-4896-8e07-17cf8e0260ef response_code = 200 uri = /v2p
20352025-01-22T09:25:30.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49644
20362025-01-22T09:25:30.404ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20372025-01-22T09:25:30.440ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20382025-01-22T09:25:30.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86640 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49644 req_id = f0e125e8-2f9e-4914-bc57-ae54ddc35494 response_code = 204 uri = /switch-ports
20392025-01-22T09:25:30.491ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49644 req_id = 33bf4b0c-89c8-46be-8436-ba14af086c2b response_code = 200 uri = /network-bootstore-config
20402025-01-22T09:25:39.750ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52470
20412025-01-22T09:25:39.750ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 34 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52470 req_id = 0bd7cb2a-2d42-4cb2-9306-2c6133b01a05 response_code = 200 uri = /baseboard
20422025-01-22T09:25:40.558ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7766 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = d96d00dd-6d36-4dc9-9c38-60546631399b response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
20432025-01-22T09:25:59.636ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34295
20442025-01-22T09:25:59.636ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34295 req_id = 311b33b3-9fc7-4edc-a9a4-1bd5275b5e14 response_code = 200 uri = /vpc-routes
20452025-01-22T09:25:59.710ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
20462025-01-22T09:25:59.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34295 req_id = e10707be-c279-49c2-b83a-7ee098170522 response_code = 204 uri = /eip-gateways
20472025-01-22T09:25:59.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34295 req_id = 2d44d9d8-804f-4add-9ea6-1c952618a757 response_code = 204 uri = /vpc-routes
20482025-01-22T09:25:59.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53802
20492025-01-22T09:25:59.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53802 req_id = 2fbaca94-f60d-4bba-a883-9ecb1eaa461d response_code = 200 uri = /v2p
20502025-01-22T09:26:00.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51022
20512025-01-22T09:26:00.006ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20522025-01-22T09:26:00.056ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20532025-01-22T09:26:00.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143290 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51022 req_id = 959fe977-35f1-4042-a366-f22b5a6c6fef response_code = 204 uri = /switch-ports
20542025-01-22T09:26:00.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62869
20552025-01-22T09:26:00.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62869 req_id = 5b13172c-dc5e-4c5a-a514-dc02744ea116 response_code = 200 uri = /vpc-routes
20562025-01-22T09:26:00.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 286 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51022 req_id = 9af0920a-9f45-474e-9c7d-f48ae8072fe8 response_code = 200 uri = /network-bootstore-config
20572025-01-22T09:26:00.217ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
20582025-01-22T09:26:00.217ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62869 req_id = e4efc876-7f24-4fe4-9596-83d3a53002cb response_code = 204 uri = /eip-gateways
20592025-01-22T09:26:00.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62869 req_id = 5a2aad8b-ea4d-4a76-873e-d1a1590d55d6 response_code = 204 uri = /vpc-routes
20602025-01-22T09:26:00.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56041
20612025-01-22T09:26:00.374ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20622025-01-22T09:26:00.414ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20632025-01-22T09:26:00.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101360 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56041 req_id = 09cb5cf7-e4e0-4995-b3c8-6e8655faf579 response_code = 204 uri = /switch-ports
20642025-01-22T09:26:00.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64806
20652025-01-22T09:26:00.476ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43367
20662025-01-22T09:26:00.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64806 req_id = 0db9168b-3aa5-4fa0-9b8a-4adb689c9607 response_code = 200 uri = /v2p
20672025-01-22T09:26:00.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 282 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56041 req_id = 56c09e4a-8d2d-4d01-90df-ee35ad2ca2d6 response_code = 200 uri = /network-bootstore-config
20682025-01-22T09:26:00.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43367 req_id = a1aaa701-8816-4cdd-a47f-6cef0ab99dae response_code = 200 uri = /vpc-routes
20692025-01-22T09:26:00.522ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
20702025-01-22T09:26:00.522ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43367 req_id = e69346be-cd9d-4c26-9b9b-bae3e58bfe9e response_code = 204 uri = /eip-gateways
20712025-01-22T09:26:00.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 266 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43367 req_id = eb79c9b5-8a5e-473c-94fd-ec6568376e1e response_code = 204 uri = /vpc-routes
20722025-01-22T09:26:00.612ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42776
20732025-01-22T09:26:00.612ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42776 req_id = 736b993d-ea72-4d27-b1f4-652161bfbdf7 response_code = 200 uri = /v2p
20742025-01-22T09:26:00.666ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39752
20752025-01-22T09:26:00.666ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20762025-01-22T09:26:00.705ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20772025-01-22T09:26:00.761ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95431 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39752 req_id = 89ffda81-5cf0-4b42-b2c5-780277a5ef18 response_code = 204 uri = /switch-ports
20782025-01-22T09:26:00.762ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 198 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39752 req_id = 26611a2b-2346-477f-a05d-4ddac6ac3784 response_code = 200 uri = /network-bootstore-config
20792025-01-22T09:26:09.783ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39141
20802025-01-22T09:26:09.783ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39141 req_id = 2502c2c4-a2ba-40f1-99ca-7ce8b420abd5 response_code = 200 uri = /baseboard
20812025-01-22T09:26:10.560ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8969 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 4f211647-493b-43a4-a6bb-fc60c19a4324 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
20822025-01-22T09:26:29.731ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56505
20832025-01-22T09:26:29.731ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56505 req_id = a1d55a1e-0417-41d2-a997-538b22400143 response_code = 200 uri = /vpc-routes
20842025-01-22T09:26:29.746ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
20852025-01-22T09:26:29.746ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56505 req_id = aa638e6d-6b21-4e62-b8d3-1a86ce2dd7fe response_code = 204 uri = /eip-gateways
20862025-01-22T09:26:29.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56505 req_id = b34e1d97-20be-4443-8fc1-d0dc4a9ea4b0 response_code = 204 uri = /vpc-routes
20872025-01-22T09:26:29.788ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42563
20882025-01-22T09:26:29.788ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20892025-01-22T09:26:29.828ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20902025-01-22T09:26:29.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120112 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42563 req_id = f4691d59-fc4a-4377-9110-d5b3502997bb response_code = 204 uri = /switch-ports
20912025-01-22T09:26:29.908ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63126
20922025-01-22T09:26:29.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63126 req_id = e2a32c15-d9fb-426d-a2d7-a9658ce88136 response_code = 200 uri = /v2p
20932025-01-22T09:26:29.908ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 212 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42563 req_id = 911021b0-8d15-46b0-a489-8e836850be2c response_code = 200 uri = /network-bootstore-config
20942025-01-22T09:26:30.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39426
20952025-01-22T09:26:30.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39426 req_id = a3425c54-0350-4bd8-8569-4106bb21de00 response_code = 200 uri = /vpc-routes
20962025-01-22T09:26:30.084ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
20972025-01-22T09:26:30.084ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39426 req_id = 99e58009-5e41-45fb-b378-072a03477e54 response_code = 204 uri = /eip-gateways
20982025-01-22T09:26:30.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 200 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39426 req_id = 6573ac1e-ed61-4605-9968-e42bd16b1f15 response_code = 204 uri = /vpc-routes
20992025-01-22T09:26:30.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41115
21002025-01-22T09:26:30.125ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21012025-01-22T09:26:30.169ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21022025-01-22T09:26:30.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109788 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41115 req_id = 64c60a5f-a143-4e55-9dc7-08663d8a5bf7 response_code = 204 uri = /switch-ports
21032025-01-22T09:26:30.235ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43331
21042025-01-22T09:26:30.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 257 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41115 req_id = 15e35f01-ebfb-4e37-aab4-6835f4f63485 response_code = 200 uri = /network-bootstore-config
21052025-01-22T09:26:30.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43331 req_id = d3ffd671-0264-4971-b1ad-e15a9edeaf2a response_code = 200 uri = /v2p
21062025-01-22T09:26:30.273ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63563
21072025-01-22T09:26:30.273ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63563 req_id = cd4ea1c1-9e96-4514-89a5-530d53157b92 response_code = 200 uri = /vpc-routes
21082025-01-22T09:26:30.316ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
21092025-01-22T09:26:30.316ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63563 req_id = 7937100b-99ef-4dd2-b70b-8860dcdba2ce response_code = 204 uri = /eip-gateways
21102025-01-22T09:26:30.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 285 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63563 req_id = 03fa8a37-73f1-40d4-8a49-331abdb19757 response_code = 204 uri = /vpc-routes
21112025-01-22T09:26:30.374ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52241
21122025-01-22T09:26:30.374ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52241 req_id = 90a4b463-c4aa-4419-b0e9-17a8c1fff6c2 response_code = 200 uri = /v2p
21132025-01-22T09:26:30.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48949
21142025-01-22T09:26:30.387ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21152025-01-22T09:26:30.429ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21162025-01-22T09:26:30.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94489 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48949 req_id = 065be6cb-fdf2-4ca5-b0af-30382255b176 response_code = 204 uri = /switch-ports
21172025-01-22T09:26:30.487ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48949 req_id = 3c6a0cc6-2d8f-4777-aafc-0e70dd0ca928 response_code = 200 uri = /network-bootstore-config
21182025-01-22T09:26:39.817ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64152
21192025-01-22T09:26:39.817ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64152 req_id = 151a2c26-b841-4180-bbd4-92211c708528 response_code = 200 uri = /baseboard
21202025-01-22T09:26:40.558ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6981 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 55d1580d-8265-44d0-85b7-3478f1d3bc6c response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
21212025-01-22T09:26:59.655ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33375
21222025-01-22T09:26:59.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33375 req_id = d864c80e-153f-4adb-a923-98051165c1aa response_code = 200 uri = /vpc-routes
21232025-01-22T09:26:59.712ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
21242025-01-22T09:26:59.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33375 req_id = 937a2fea-1f44-4d90-99c8-7c9684d8054b response_code = 204 uri = /eip-gateways
21252025-01-22T09:26:59.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 254 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33375 req_id = 985b5b50-a8ec-4347-9bcc-ba1a62225137 response_code = 204 uri = /vpc-routes
21262025-01-22T09:26:59.918ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:48735
21272025-01-22T09:26:59.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:48735 req_id = 300e7000-57a9-429a-8774-427912397e5e response_code = 200 uri = /v2p
21282025-01-22T09:26:59.971ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54860
21292025-01-22T09:26:59.971ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21302025-01-22T09:27:00.020ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21312025-01-22T09:27:00.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148652 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54860 req_id = e36cfd87-55d2-43ed-92bc-c70d9c36aa9e response_code = 204 uri = /switch-ports
21322025-01-22T09:27:00.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54860 req_id = 59dc7a80-35ca-418c-9b60-3952daf375cc response_code = 200 uri = /network-bootstore-config
21332025-01-22T09:27:00.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62472
21342025-01-22T09:27:00.226ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21352025-01-22T09:27:00.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21362025-01-22T09:27:00.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21372025-01-22T09:27:00.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21382025-01-22T09:27:00.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21392025-01-22T09:27:00.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21402025-01-22T09:27:00.226ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21412025-01-22T09:27:00.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 470 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62472 req_id = ea4e5914-5a43-43b6-a1ee-faf6e51e107c response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21422025-01-22T09:27:00.280ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38529
21432025-01-22T09:27:00.280ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38529 req_id = d8a14de4-3606-4e60-81cd-1616709e8958 response_code = 200 uri = /vpc-routes
21442025-01-22T09:27:00.348ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
21452025-01-22T09:27:00.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38529 req_id = b9d081be-cf2e-4e79-b5f7-4a44b950fdae response_code = 204 uri = /eip-gateways
21462025-01-22T09:27:00.358ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 227 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38529 req_id = f248047c-f72f-45be-8793-39077663765f response_code = 204 uri = /vpc-routes
21472025-01-22T09:27:00.384ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39342
21482025-01-22T09:27:00.384ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39342 req_id = 305297ce-4a44-45cd-a8a2-cc645dbd527e response_code = 200 uri = /vpc-routes
21492025-01-22T09:27:00.435ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
21502025-01-22T09:27:00.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39342 req_id = 55417f0a-79cc-4c9e-9497-784aef91b234 response_code = 204 uri = /eip-gateways
21512025-01-22T09:27:00.446ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39342 req_id = 1165e157-de81-4d39-ac81-f8a4ad9c30f0 response_code = 204 uri = /vpc-routes
21522025-01-22T09:27:00.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65398
21532025-01-22T09:27:00.480ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65398 req_id = 9fee2ccc-e65f-4b7f-82a2-af7ac7b9de5b response_code = 200 uri = /v2p
21542025-01-22T09:27:00.507ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34515
21552025-01-22T09:27:00.507ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21562025-01-22T09:27:00.564ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21572025-01-22T09:27:00.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149948 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:34515 req_id = be08ef19-22ce-4e82-857d-a7f53a873b1f response_code = 204 uri = /switch-ports
21582025-01-22T09:27:00.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45652
21592025-01-22T09:27:00.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51738
21602025-01-22T09:27:00.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42115
21612025-01-22T09:27:00.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34515 req_id = e670f6e2-232d-4e1b-b148-d8501b63adb8 response_code = 200 uri = /network-bootstore-config
21622025-01-22T09:27:00.658ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21632025-01-22T09:27:00.658ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21642025-01-22T09:27:00.658ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21652025-01-22T09:27:00.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21662025-01-22T09:27:00.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21672025-01-22T09:27:00.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21682025-01-22T09:27:00.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21692025-01-22T09:27:00.665ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21702025-01-22T09:27:00.665ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7947 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45652 req_id = c8614f3c-d140-4284-a71a-d15e14692b16 response_code = 200 uri = /v2p
21712025-01-22T09:27:00.666ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8187 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:42115 req_id = 2383e455-e9ba-48f6-8f20-4c1b9084f6f3 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21722025-01-22T09:27:00.710ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21732025-01-22T09:27:00.789ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132028 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:51738 req_id = bd80a870-608c-40de-beb5-0421bb106e5a response_code = 204 uri = /switch-ports
21742025-01-22T09:27:00.793ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40832
21752025-01-22T09:27:00.793ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21762025-01-22T09:27:00.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21772025-01-22T09:27:00.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21782025-01-22T09:27:00.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21792025-01-22T09:27:00.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21802025-01-22T09:27:00.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21812025-01-22T09:27:00.793ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21822025-01-22T09:27:00.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 329 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40832 req_id = 5c0a33f5-d7e1-49a1-a7b3-5540e10a9f4f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21832025-01-22T09:27:00.794ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4648 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51738 req_id = 0131ccc0-9d80-4db0-a28a-15407f70de24 response_code = 200 uri = /network-bootstore-config
21842025-01-22T09:27:09.852ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:42793
21852025-01-22T09:27:09.852ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:42793 req_id = f0a95960-ec71-4fa4-8ddb-d5252670cd7c response_code = 200 uri = /baseboard
21862025-01-22T09:27:10.559ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7731 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 87707e4f-f045-43d3-912c-db91319a4d71 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
21872025-01-22T09:27:29.675ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53417
21882025-01-22T09:27:29.675ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53417 req_id = 66623710-d47a-4ead-b55e-833081515be6 response_code = 200 uri = /vpc-routes
21892025-01-22T09:27:29.715ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
21902025-01-22T09:27:29.715ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53417 req_id = ade04c04-83d8-4086-8b84-5cae7d690218 response_code = 204 uri = /eip-gateways
21912025-01-22T09:27:29.737ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39988
21922025-01-22T09:27:29.737ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39988 req_id = 41f14e13-4a2b-4de5-982d-2293de28f1b3 response_code = 200 uri = /v2p
21932025-01-22T09:27:29.744ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53417 req_id = 1ed190e6-330e-4296-bad2-b955dc74c931 response_code = 204 uri = /vpc-routes
21942025-01-22T09:27:29.807ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44036
21952025-01-22T09:27:29.807ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21962025-01-22T09:27:29.851ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21972025-01-22T09:27:29.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124522 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44036 req_id = 1a6901e9-3ac9-4cb1-acf6-e3dfd6221d52 response_code = 204 uri = /switch-ports
21982025-01-22T09:27:29.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44036 req_id = bc8928d1-2920-4fa3-8f54-83b02927ca0b response_code = 200 uri = /network-bootstore-config
21992025-01-22T09:27:29.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33605
22002025-01-22T09:27:29.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33605 req_id = 4ab18fc7-6eeb-48dd-b458-47410bfe9d36 response_code = 200 uri = /vpc-routes
22012025-01-22T09:27:30.004ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
22022025-01-22T09:27:30.004ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33605 req_id = a18645ba-c2e1-4c31-8e0c-5d2a11238d76 response_code = 204 uri = /eip-gateways
22032025-01-22T09:27:30.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 299 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33605 req_id = cfc15d7e-6d57-422f-843d-42c4595a73e0 response_code = 204 uri = /vpc-routes
22042025-01-22T09:27:30.033ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46160
22052025-01-22T09:27:30.033ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46160 req_id = 77415e7d-2def-4bcd-9832-141a9f88cba9 response_code = 200 uri = /v2p
22062025-01-22T09:27:30.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41564
22072025-01-22T09:27:30.086ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22082025-01-22T09:27:30.126ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22092025-01-22T09:27:30.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96050 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41564 req_id = d7c05c23-4b94-4ed8-990a-97eb9d0c9d3d response_code = 204 uri = /switch-ports
22102025-01-22T09:27:30.183ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43129
22112025-01-22T09:27:30.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43129 req_id = 3d1b5446-a002-4c10-ab07-de307cce111c response_code = 200 uri = /vpc-routes
22122025-01-22T09:27:30.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41564 req_id = a87c8b3f-c426-4f38-8b6a-837f25652299 response_code = 200 uri = /network-bootstore-config
22132025-01-22T09:27:30.247ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
22142025-01-22T09:27:30.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43129 req_id = a745b699-cb38-46e1-9365-5c4deb355199 response_code = 204 uri = /eip-gateways
22152025-01-22T09:27:30.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43129 req_id = 91d8cec0-e5d9-418e-87f6-51f3d0903331 response_code = 204 uri = /vpc-routes
22162025-01-22T09:27:30.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34268
22172025-01-22T09:27:30.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34268 req_id = 91b983f0-431c-4316-88cb-eb12d0182c1d response_code = 200 uri = /v2p
22182025-01-22T09:27:30.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48880
22192025-01-22T09:27:30.412ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22202025-01-22T09:27:30.451ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22212025-01-22T09:27:30.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93415 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48880 req_id = 03ccbd8b-223b-40e1-a383-96621d1a4b83 response_code = 204 uri = /switch-ports
22222025-01-22T09:27:30.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48880 req_id = 2039924e-3cae-4ffa-8d86-b1a6c91d0f43 response_code = 200 uri = /network-bootstore-config
22232025-01-22T09:27:39.885ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:50158
22242025-01-22T09:27:39.885ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:50158 req_id = d579e281-c643-48ed-a1ab-ba714ef3dee1 response_code = 200 uri = /baseboard
22252025-01-22T09:27:40.558ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7024 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 40e44a48-3b97-488d-a4c3-12d6a222de7f response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
22262025-01-22T09:27:59.735ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45575
22272025-01-22T09:27:59.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45575 req_id = a24e0983-109b-4fc7-bdac-af9a449b14fc response_code = 200 uri = /vpc-routes
22282025-01-22T09:27:59.777ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
22292025-01-22T09:27:59.777ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45575 req_id = f6bb750f-5298-4552-98c7-ce72204c664e response_code = 204 uri = /eip-gateways
22302025-01-22T09:27:59.787ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45575 req_id = b61ab339-c026-4d0f-b42c-feb22b152f0e response_code = 204 uri = /vpc-routes
22312025-01-22T09:27:59.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34368
22322025-01-22T09:27:59.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 183 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34368 req_id = 20b17820-e0b3-4661-8db7-f984596fe2bd response_code = 200 uri = /v2p
22332025-01-22T09:28:00.013ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34753
22342025-01-22T09:28:00.013ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22352025-01-22T09:28:00.069ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22362025-01-22T09:28:00.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149871 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34753 req_id = c74fd949-c45a-4ac9-bfc8-ad5c1c5b2465 response_code = 204 uri = /switch-ports
22372025-01-22T09:28:00.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37064
22382025-01-22T09:28:00.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37064 req_id = d23dbb20-ce1c-46f2-9cf6-074845e3ab1a response_code = 200 uri = /vpc-routes
22392025-01-22T09:28:00.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34753 req_id = 74dfffd7-14f0-4fe2-be62-3e92e37e8d08 response_code = 200 uri = /network-bootstore-config
22402025-01-22T09:28:00.219ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
22412025-01-22T09:28:00.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37064 req_id = 6a058e60-d71f-4487-9617-4674c95d3ca4 response_code = 204 uri = /eip-gateways
22422025-01-22T09:28:00.230ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 249 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37064 req_id = b82d0652-42c3-475b-b56d-5afbbaca7ff4 response_code = 204 uri = /vpc-routes
22432025-01-22T09:28:00.370ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62216
22442025-01-22T09:28:00.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62216 req_id = 53abc455-2bba-4252-8634-fad8c38ad6d1 response_code = 200 uri = /v2p
22452025-01-22T09:28:00.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45793
22462025-01-22T09:28:00.435ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22472025-01-22T09:28:00.475ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22482025-01-22T09:28:00.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104797 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45793 req_id = a841a919-4297-4780-872a-ece82583b915 response_code = 204 uri = /switch-ports
22492025-01-22T09:28:00.540ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45803
22502025-01-22T09:28:00.540ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45793 req_id = a5aef0a9-e927-4545-879e-a2ed666e143a response_code = 200 uri = /network-bootstore-config
22512025-01-22T09:28:00.542ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45803 req_id = 5d7565b1-1595-47c7-9978-7e2efedfc05b response_code = 200 uri = /vpc-routes
22522025-01-22T09:28:00.555ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
22532025-01-22T09:28:00.555ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45803 req_id = fd43d5ab-d838-4f41-8f80-d5bbaa162646 response_code = 204 uri = /eip-gateways
22542025-01-22T09:28:00.710ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39360
22552025-01-22T09:28:00.710ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39360 req_id = 5450bf92-b31d-4982-af0e-48d0d5287e08 response_code = 200 uri = /v2p
22562025-01-22T09:28:00.713ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45803 req_id = 6a6b94dd-c74c-4093-978b-8f6de2b441f8 response_code = 204 uri = /vpc-routes
22572025-01-22T09:28:00.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33114
22582025-01-22T09:28:00.756ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22592025-01-22T09:28:00.796ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22602025-01-22T09:28:00.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99006 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:33114 req_id = db5ad4b9-e4bc-46f5-936a-716c3c5bfa21 response_code = 204 uri = /switch-ports
22612025-01-22T09:28:00.855ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33114 req_id = 85d9598b-6e01-483f-8cf6-b66785670d6d response_code = 200 uri = /network-bootstore-config
22622025-01-22T09:28:09.918ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47907
22632025-01-22T09:28:09.919ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47907 req_id = d39b206e-ccbb-419f-8597-8a6f0a502c5b response_code = 200 uri = /baseboard
22642025-01-22T09:28:10.560ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7980 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 33f59241-4c8a-4c33-b2a0-101476b62c97 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
22652025-01-22T09:28:29.575ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43643
22662025-01-22T09:28:29.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43643 req_id = f639e103-9fad-4e4c-a28a-de266e188ca0 response_code = 200 uri = /vpc-routes
22672025-01-22T09:28:29.631ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
22682025-01-22T09:28:29.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43643 req_id = 948079d2-7a7d-4298-b34d-631b0ffcde46 response_code = 204 uri = /eip-gateways
22692025-01-22T09:28:29.640ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 239 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:43643 req_id = 5441834d-388b-4418-97eb-b4f80713f159 response_code = 204 uri = /vpc-routes
22702025-01-22T09:28:29.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34644
22712025-01-22T09:28:29.775ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22722025-01-22T09:28:29.814ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22732025-01-22T09:28:29.889ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114228 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:34644 req_id = c33a28f0-6566-401c-8a44-76e38d94eaf8 response_code = 204 uri = /switch-ports
22742025-01-22T09:28:29.890ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52156
22752025-01-22T09:28:29.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52156 req_id = fbf876d3-9a9d-4b2d-b756-33134d44faa5 response_code = 200 uri = /v2p
22762025-01-22T09:28:29.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34644 req_id = efc4354a-ea25-4bc4-ac13-eac8e816e57e response_code = 200 uri = /network-bootstore-config
22772025-01-22T09:28:30.028ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37869
22782025-01-22T09:28:30.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37869 req_id = 0835bf1b-cc13-4b85-ad9d-e9c5d18b1fdd response_code = 200 uri = /vpc-routes
22792025-01-22T09:28:30.102ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
22802025-01-22T09:28:30.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37869 req_id = fc7f978a-6f69-4ee7-ac6f-663364581783 response_code = 204 uri = /eip-gateways
22812025-01-22T09:28:30.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:37869 req_id = 439ded00-7d37-4436-b650-5c0a68a1cd0f response_code = 204 uri = /vpc-routes
22822025-01-22T09:28:30.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42860
22832025-01-22T09:28:30.144ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22842025-01-22T09:28:30.186ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22852025-01-22T09:28:30.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105408 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42860 req_id = 047f3064-16be-49b1-ab5e-f1d3d4bf20d4 response_code = 204 uri = /switch-ports
22862025-01-22T09:28:30.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52191
22872025-01-22T09:28:30.250ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39143
22882025-01-22T09:28:30.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42860 req_id = 7f86b22e-524d-47b8-a929-0fdd4b97460a response_code = 200 uri = /network-bootstore-config
22892025-01-22T09:28:30.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 274 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52191 req_id = 0a26613f-1d88-4f57-b8ea-481c90a31401 response_code = 200 uri = /v2p
22902025-01-22T09:28:30.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39143 req_id = 5477a16d-1baa-49e7-9123-d8fa5ef3cca7 response_code = 200 uri = /vpc-routes
22912025-01-22T09:28:30.264ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
22922025-01-22T09:28:30.264ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39143 req_id = db79b23b-40c6-40c6-92ea-c6a8404b5891 response_code = 204 uri = /eip-gateways
22932025-01-22T09:28:30.289ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62027
22942025-01-22T09:28:30.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62027 req_id = 3be888e0-82c2-4e8e-841d-a7fe7b1c08a3 response_code = 200 uri = /v2p
22952025-01-22T09:28:30.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39143 req_id = 5b3c86ea-b4d0-4af2-b4df-074666f7ffd3 response_code = 204 uri = /vpc-routes
22962025-01-22T09:28:30.345ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42652
22972025-01-22T09:28:30.345ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22982025-01-22T09:28:30.383ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22992025-01-22T09:28:30.440ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94783 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42652 req_id = 63990b35-7d46-400f-90d6-d563bc5e6493 response_code = 204 uri = /switch-ports
23002025-01-22T09:28:30.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42652 req_id = 3bdd28ac-3b43-4282-ba5a-964ad6793539 response_code = 200 uri = /network-bootstore-config
23012025-01-22T09:28:39.953ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:51126
23022025-01-22T09:28:39.953ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:51126 req_id = 2d88819f-65cf-4a9a-8d10-9fcadbecbb95 response_code = 200 uri = /baseboard
23032025-01-22T09:28:40.559ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7268 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = eb61f71c-e237-4899-9f6e-491abc2ad9a8 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
23042025-01-22T09:28:59.880ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38448
23052025-01-22T09:28:59.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38448 req_id = 8cba689d-6357-46d2-837b-6903fa07c9ed response_code = 200 uri = /vpc-routes
23062025-01-22T09:28:59.947ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
23072025-01-22T09:28:59.947ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 131 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38448 req_id = b198497b-0c11-49fa-b6ce-dec9d09d7cae response_code = 204 uri = /eip-gateways
23082025-01-22T09:28:59.957ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38448 req_id = 6bc6021d-f232-410f-aa15-2893e09a2532 response_code = 204 uri = /vpc-routes
23092025-01-22T09:29:00.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54146
23102025-01-22T09:29:00.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54146 req_id = c148af60-aaad-4456-b330-168c9e1fc748 response_code = 200 uri = /v2p
23112025-01-22T09:29:00.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:44298
23122025-01-22T09:29:00.025ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23132025-01-22T09:29:00.091ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23142025-01-22T09:29:00.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154661 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:44298 req_id = 1fb7dce0-36c5-47a1-850a-6aa19f85f5e7 response_code = 204 uri = /switch-ports
23152025-01-22T09:29:00.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39036
23162025-01-22T09:29:00.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39036 req_id = 8a13bb7a-912c-4259-a3bc-6a12441eb28f response_code = 200 uri = /vpc-routes
23172025-01-22T09:29:00.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:44298 req_id = 4aa7a117-d142-4da3-bfc8-52040fa725cf response_code = 200 uri = /network-bootstore-config
23182025-01-22T09:29:00.231ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
23192025-01-22T09:29:00.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39036 req_id = 3362756f-ac36-4b5f-afe3-85398ab233d4 response_code = 204 uri = /eip-gateways
23202025-01-22T09:29:00.241ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 287 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39036 req_id = a0f475ef-7cf2-4ac0-a663-ffef60647a20 response_code = 204 uri = /vpc-routes
23212025-01-22T09:29:00.282ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53387
23222025-01-22T09:29:00.283ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53387 req_id = 6280e577-ea09-4fd4-af05-4339232a54c8 response_code = 200 uri = /vpc-routes
23232025-01-22T09:29:00.337ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
23242025-01-22T09:29:00.337ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53387 req_id = 22517dd5-1b27-4e3c-824d-c1b181921c6b response_code = 204 uri = /eip-gateways
23252025-01-22T09:29:00.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53387 req_id = b890dfe7-da52-43bd-beb7-28ce889b61e4 response_code = 204 uri = /vpc-routes
23262025-01-22T09:29:00.388ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51536
23272025-01-22T09:29:00.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51536 req_id = 198cfe7f-b98e-4ffe-b727-dc38b3593616 response_code = 200 uri = /v2p
23282025-01-22T09:29:00.475ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51376
23292025-01-22T09:29:00.475ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51376 req_id = f80e89ef-c0c3-4500-a4a7-0a3297dd85d1 response_code = 200 uri = /v2p
23302025-01-22T09:29:00.508ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61042
23312025-01-22T09:29:00.508ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23322025-01-22T09:29:00.548ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23332025-01-22T09:29:00.609ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101176 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61042 req_id = 84bf5862-5fbf-4327-a0aa-70a2285c7eff response_code = 204 uri = /switch-ports
23342025-01-22T09:29:00.609ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59481
23352025-01-22T09:29:00.609ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23362025-01-22T09:29:00.643ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23372025-01-22T09:29:00.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86125 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:59481 req_id = f473a00c-ee01-4c53-96b2-c708170efe9c response_code = 204 uri = /switch-ports
23382025-01-22T09:29:00.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59481 req_id = b36a345a-a1f0-46b6-a4e2-db868bb48210 response_code = 200 uri = /network-bootstore-config
23392025-01-22T09:29:00.695ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61042 req_id = 558f71cd-d88c-47f1-9c4c-266f501fca2d response_code = 200 uri = /network-bootstore-config
23402025-01-22T09:29:09.988ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35171
23412025-01-22T09:29:09.988ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35171 req_id = 0d919082-b721-4194-96ed-9347a1a8767c response_code = 200 uri = /baseboard
23422025-01-22T09:29:10.558ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6420 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 73ec64a3-9715-42cd-b51c-272a4022f599 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
23432025-01-22T09:29:29.656ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49698
23442025-01-22T09:29:29.656ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49698 req_id = 10f02e7b-5442-4ba2-b1b2-24276e908467 response_code = 200 uri = /vpc-routes
23452025-01-22T09:29:29.673ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43356
23462025-01-22T09:29:29.673ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43356 req_id = 811e5d1a-2d81-44b6-b0ef-c50968e0f167 response_code = 200 uri = /v2p
23472025-01-22T09:29:29.716ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
23482025-01-22T09:29:29.716ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49698 req_id = e42de2af-4fd0-44c0-807b-c1ae5c86e555 response_code = 204 uri = /eip-gateways
23492025-01-22T09:29:29.725ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:49698 req_id = 093608fc-686a-4de6-b108-ecb2b6b482d6 response_code = 204 uri = /vpc-routes
23502025-01-22T09:29:29.800ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61597
23512025-01-22T09:29:29.800ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23522025-01-22T09:29:29.842ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23532025-01-22T09:29:29.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126513 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61597 req_id = 079a1c5d-d73d-41c9-a986-2d30215391aa response_code = 204 uri = /switch-ports
23542025-01-22T09:29:29.926ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61597 req_id = 22f63de9-1d97-4af7-a7d6-e31230215a09 response_code = 200 uri = /network-bootstore-config
23552025-01-22T09:29:29.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65058
23562025-01-22T09:29:29.987ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65058 req_id = 05d07545-8c84-4f54-87ce-0a135c2518f0 response_code = 200 uri = /vpc-routes
23572025-01-22T09:29:30.029ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
23582025-01-22T09:29:30.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65058 req_id = 6c39b759-ea4c-4538-ab59-a807cedcc68b response_code = 204 uri = /eip-gateways
23592025-01-22T09:29:30.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 267 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:65058 req_id = 4ced07fb-4676-4076-acfb-a95f824ff4ac response_code = 204 uri = /vpc-routes
23602025-01-22T09:29:30.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:52303
23612025-01-22T09:29:30.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 65 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:52303 req_id = ac689afa-fe0b-4083-8191-8ba5afd01302 response_code = 200 uri = /vpc-routes
23622025-01-22T09:29:30.267ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
23632025-01-22T09:29:30.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52303 req_id = 2b10a4f0-099a-46b2-abf9-1f9d5e259bab response_code = 204 uri = /eip-gateways
23642025-01-22T09:29:30.275ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56615
23652025-01-22T09:29:30.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56615 req_id = 4223c3ae-9f37-4598-b39a-08fbc7318d75 response_code = 200 uri = /v2p
23662025-01-22T09:29:30.277ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 264 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:52303 req_id = 8deddee1-cbc2-419d-9edd-9b914e38653c response_code = 204 uri = /vpc-routes
23672025-01-22T09:29:30.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43027
23682025-01-22T09:29:30.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23692025-01-22T09:29:30.333ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23702025-01-22T09:29:30.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93863 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:43027 req_id = 85f03d51-886a-4615-90e8-d427b2c36726 response_code = 204 uri = /switch-ports
23712025-01-22T09:29:30.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37453
23722025-01-22T09:29:30.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54658
23732025-01-22T09:29:30.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54658 req_id = 41b2c8ce-5ff9-410d-9c9d-7a2cc26fa394 response_code = 200 uri = /v2p
23742025-01-22T09:29:30.387ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43027 req_id = a42d2b0c-4750-484c-a084-7dfd9bc4a6fb response_code = 200 uri = /network-bootstore-config
23752025-01-22T09:29:30.387ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23762025-01-22T09:29:30.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23772025-01-22T09:29:30.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89145 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37453 req_id = 632df043-cd7f-429c-8855-dae19c90b3ed response_code = 204 uri = /switch-ports
23782025-01-22T09:29:30.476ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 153 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37453 req_id = f062a21e-a1ac-46ab-a1b0-c41b16083a59 response_code = 200 uri = /network-bootstore-config
23792025-01-22T09:29:33.527ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
23802025-01-22T09:29:33.528ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
23812025-01-22T09:29:33.564ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 13540, tv_nsec: 694633403 } time_to_next_cleanup = 599.99999812s
23822025-01-22T09:29:40.021ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47609
23832025-01-22T09:29:40.021ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47609 req_id = 24e61175-65e7-4f87-b1f0-c72d74b8fb4e response_code = 200 uri = /baseboard
23842025-01-22T09:29:40.561ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7906 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = cebe09a3-9e5c-4ed6-bb6b-9674299b0ac5 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
23852025-01-22T09:29:48.108ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23862025-01-22T09:29:59.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63126
23872025-01-22T09:29:59.768ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63126 req_id = 0be9d2a8-ef70-4fad-bb00-1afe38a526a2 response_code = 200 uri = /vpc-routes
23882025-01-22T09:29:59.783ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
23892025-01-22T09:29:59.783ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63126 req_id = ec1af695-ff6e-4251-8d0a-74ab2700cdd6 response_code = 204 uri = /eip-gateways
23902025-01-22T09:29:59.793ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63126 req_id = 5f66186a-028a-44c6-9f3e-41bcc01ff59b response_code = 204 uri = /vpc-routes
23912025-01-22T09:29:59.975ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58353
23922025-01-22T09:29:59.976ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58353 req_id = 2b32ea76-dca7-4ecb-9358-82483c7339d6 response_code = 200 uri = /v2p
23932025-01-22T09:29:59.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54103
23942025-01-22T09:29:59.999ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23952025-01-22T09:30:00.051ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23962025-01-22T09:30:00.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148821 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54103 req_id = aa3236c4-5f08-4266-b9cc-2aacd3e94b0f response_code = 204 uri = /switch-ports
23972025-01-22T09:30:00.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54103 req_id = 4e0edf9f-b92e-49fe-bb5d-a098c584d04a response_code = 200 uri = /network-bootstore-config
23982025-01-22T09:30:00.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39501
23992025-01-22T09:30:00.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39501 req_id = 4e71f7aa-b4ca-46fc-9781-bbb765cdb57d response_code = 200 uri = /vpc-routes
24002025-01-22T09:30:00.201ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
24012025-01-22T09:30:00.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39501 req_id = 35dbf951-cc22-4e7b-bd3c-3e89b3c77b0c response_code = 204 uri = /eip-gateways
24022025-01-22T09:30:00.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58703
24032025-01-22T09:30:00.225ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58703 req_id = 71fa113a-37a6-4f9b-963f-c848b64ef42b response_code = 200 uri = /v2p
24042025-01-22T09:30:00.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39501 req_id = 8ea61131-f246-402a-b8c5-b29907bd55e5 response_code = 204 uri = /vpc-routes
24052025-01-22T09:30:00.352ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63499
24062025-01-22T09:30:00.352ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24072025-01-22T09:30:00.407ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24082025-01-22T09:30:00.494ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 142462 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:63499 req_id = 20b2abae-5532-4fe6-9858-d5068ff62f47 response_code = 204 uri = /switch-ports
24092025-01-22T09:30:00.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:32884
24102025-01-22T09:30:00.494ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40572
24112025-01-22T09:30:00.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 135 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63499 req_id = 6d62e8ac-cb4c-41c4-9059-5e50bd5202c9 response_code = 200 uri = /network-bootstore-config
24122025-01-22T09:30:00.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 159 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:32884 req_id = 050d9c29-0504-452a-a27c-9906d83605cf response_code = 200 uri = /vpc-routes
24132025-01-22T09:30:00.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40572 req_id = 2cd4e2b5-0434-4c55-bfb4-3aecb9deb1a5 response_code = 200 uri = /v2p
24142025-01-22T09:30:00.514ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
24152025-01-22T09:30:00.514ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32884 req_id = c0123ad5-fd13-4249-9756-392565ec9494 response_code = 204 uri = /eip-gateways
24162025-01-22T09:30:00.526ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 258 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:32884 req_id = 3da3d2c6-6fe9-4891-8333-4c4b3b7fa46b response_code = 204 uri = /vpc-routes
24172025-01-22T09:30:00.576ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35846
24182025-01-22T09:30:00.576ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24192025-01-22T09:30:00.653ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24202025-01-22T09:30:00.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232338 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35846 req_id = d9e49d92-b6a7-44a0-b75b-18e4f17b1a69 response_code = 204 uri = /switch-ports
24212025-01-22T09:30:00.809ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 303 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35846 req_id = ca1012fb-47a2-4292-84b4-da2473a20306 response_code = 200 uri = /network-bootstore-config
24222025-01-22T09:30:10.055ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:64778
24232025-01-22T09:30:10.055ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:64778 req_id = df4df6bf-0154-40de-82fd-0bfd35c8d39d response_code = 200 uri = /baseboard
24242025-01-22T09:30:10.561ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8607 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = 54e4fdb2-c2aa-452a-b37a-dbfedc007934 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
24252025-01-22T09:30:29.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53251
24262025-01-22T09:30:29.727ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53251 req_id = f556af5e-6aed-4342-9625-f3174d14ddbe response_code = 200 uri = /vpc-routes
24272025-01-22T09:30:29.750ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53108
24282025-01-22T09:30:29.750ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53108 req_id = 5d1561f5-89fb-4bfc-8c6c-8681f98db227 response_code = 200 uri = /v2p
24292025-01-22T09:30:29.769ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
24302025-01-22T09:30:29.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53251 req_id = 2e9fbba9-35d6-4843-91fb-6202dc9cfdd4 response_code = 204 uri = /eip-gateways
24312025-01-22T09:30:29.778ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 209 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:53251 req_id = 61cd11db-56ac-425f-9f73-765deeff79d4 response_code = 204 uri = /vpc-routes
24322025-01-22T09:30:29.813ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42097
24332025-01-22T09:30:29.813ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24342025-01-22T09:30:29.859ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24352025-01-22T09:30:29.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122745 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:42097 req_id = 4c07b010-0498-412f-a778-2fbdfdf0dd8f response_code = 204 uri = /switch-ports
24362025-01-22T09:30:29.936ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42097 req_id = e3fc514b-c8f8-4b73-a520-e93697c49d19 response_code = 200 uri = /network-bootstore-config
24372025-01-22T09:30:30.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41939
24382025-01-22T09:30:30.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41939 req_id = a049e917-abd5-4408-8c6b-8d331716fc1a response_code = 200 uri = /vpc-routes
24392025-01-22T09:30:30.020ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
24402025-01-22T09:30:30.020ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 77 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41939 req_id = db382313-cd09-49cc-a895-616d857be14e response_code = 204 uri = /eip-gateways
24412025-01-22T09:30:30.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:41939 req_id = dbacb07e-2b5d-4058-8106-d5346c1ea123 response_code = 204 uri = /vpc-routes
24422025-01-22T09:30:30.122ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63052
24432025-01-22T09:30:30.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63052 req_id = 745c502a-5080-4125-b841-bd12dd6b9e50 response_code = 200 uri = /v2p
24442025-01-22T09:30:30.137ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58076
24452025-01-22T09:30:30.137ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24462025-01-22T09:30:30.178ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24472025-01-22T09:30:30.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105897 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:58076 req_id = bcf200e6-ab59-4822-a5d8-f4c90a305783 response_code = 204 uri = /switch-ports
24482025-01-22T09:30:30.243ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46735
24492025-01-22T09:30:30.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46735 req_id = a8b195fc-d992-4267-9320-ede25ff3efba response_code = 200 uri = /vpc-routes
24502025-01-22T09:30:30.243ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58076 req_id = 0d88974f-b246-49ab-bc9a-1a403a3bfc90 response_code = 200 uri = /network-bootstore-config
24512025-01-22T09:30:30.258ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
24522025-01-22T09:30:30.258ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46735 req_id = 0d8569ed-90c2-4168-975e-bfb259bc676c response_code = 204 uri = /eip-gateways
24532025-01-22T09:30:30.347ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43207
24542025-01-22T09:30:30.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43207 req_id = c47af287-2cf9-4041-9fe2-3e0464f9a3b3 response_code = 200 uri = /v2p
24552025-01-22T09:30:30.356ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46735 req_id = 2db954ca-3a03-41bc-91f2-1cccfd0e8978 response_code = 204 uri = /vpc-routes
24562025-01-22T09:30:30.404ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49685
24572025-01-22T09:30:30.404ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24582025-01-22T09:30:30.447ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24592025-01-22T09:30:30.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108680 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:49685 req_id = f4c9bb48-f310-46d1-915f-1477ab9e5c6b response_code = 204 uri = /switch-ports
24602025-01-22T09:30:30.513ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49685 req_id = d29ad645-7d64-4c41-aab9-ff0c23e57a05 response_code = 200 uri = /network-bootstore-config
24612025-01-22T09:30:40.089ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:36775
24622025-01-22T09:30:40.090ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:36775 req_id = da6ba898-b9fb-4dec-b3aa-793858c4fbe8 response_code = 200 uri = /baseboard
24632025-01-22T09:30:40.562ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9345 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = cf76ab14-27be-4d37-82b5-e97080711744 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
24642025-01-22T09:30:59.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63580
24652025-01-22T09:30:59.756ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 52 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63580 req_id = 9127f726-cef5-477b-a8c0-88577de08984 response_code = 200 uri = /vpc-routes
24662025-01-22T09:30:59.808ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
24672025-01-22T09:30:59.808ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63580 req_id = f02f6857-b999-4d27-921f-3c26a15d1afe response_code = 204 uri = /eip-gateways
24682025-01-22T09:30:59.817ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63580 req_id = b45456cb-c257-4575-91a4-35026c6889cf response_code = 204 uri = /vpc-routes
24692025-01-22T09:30:59.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46258
24702025-01-22T09:30:59.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46258 req_id = 06e68cf8-e748-4b0b-aa55-4766a7062f6e response_code = 200 uri = /v2p
24712025-01-22T09:31:00.017ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57420
24722025-01-22T09:31:00.017ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24732025-01-22T09:31:00.074ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24742025-01-22T09:31:00.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149003 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57420 req_id = cdeeaa0f-e871-4a10-af0c-33b0bb1e8fc5 response_code = 204 uri = /switch-ports
24752025-01-22T09:31:00.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57420 req_id = 343eb245-1421-470a-a8a4-69942499fc63 response_code = 200 uri = /network-bootstore-config
24762025-01-22T09:31:00.179ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64681
24772025-01-22T09:31:00.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64681 req_id = 9234c782-7df7-44cf-ad28-ddced3c1333b response_code = 200 uri = /vpc-routes
24782025-01-22T09:31:00.246ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
24792025-01-22T09:31:00.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64681 req_id = 0474e005-f192-4584-9b53-6712cf85b7da response_code = 204 uri = /eip-gateways
24802025-01-22T09:31:00.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 318 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64681 req_id = 3bb597b8-016c-4e80-9d55-9a16dad9768c response_code = 204 uri = /vpc-routes
24812025-01-22T09:31:00.296ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53672
24822025-01-22T09:31:00.296ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53672 req_id = e5c8ac19-87de-4f7a-8573-58c3c0c8f1e9 response_code = 200 uri = /vpc-routes
24832025-01-22T09:31:00.311ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
24842025-01-22T09:31:00.311ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 30 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53672 req_id = 97b6d882-cdd4-4d55-8f8c-dee5e3f92869 response_code = 204 uri = /eip-gateways
24852025-01-22T09:31:00.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:59802
24862025-01-22T09:31:00.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:59802 req_id = 31747c29-37c2-43d5-b8db-dbe29717bb4a response_code = 200 uri = /v2p
24872025-01-22T09:31:00.441ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37567
24882025-01-22T09:31:00.441ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24892025-01-22T09:31:00.478ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24902025-01-22T09:31:00.531ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90335 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:37567 req_id = 2b85e653-fdae-41b2-9619-96e5817657b8 response_code = 204 uri = /switch-ports
24912025-01-22T09:31:00.531ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60285
24922025-01-22T09:31:00.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 423 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53672 req_id = 8e14f41a-37a6-4154-9fb4-a3d8bf6c82c7 response_code = 204 uri = /vpc-routes
24932025-01-22T09:31:00.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 301 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37567 req_id = 5b337aee-5c6d-426e-95fe-a0ff8dd297f8 response_code = 200 uri = /network-bootstore-config
24942025-01-22T09:31:00.532ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60285 req_id = cac8c249-c732-4ad6-b61e-af2ac3bfa8dd response_code = 200 uri = /v2p
24952025-01-22T09:31:00.581ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46254
24962025-01-22T09:31:00.581ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24972025-01-22T09:31:00.615ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24982025-01-22T09:31:00.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87337 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:46254 req_id = fbff8b1e-e134-413c-b3ed-d11eecf42e05 response_code = 204 uri = /switch-ports
24992025-01-22T09:31:00.668ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46254 req_id = 837d1a32-1c75-4168-80b4-9a530fd5ceff response_code = 200 uri = /network-bootstore-config
25002025-01-22T09:31:10.124ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:54036
25012025-01-22T09:31:10.125ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:54036 req_id = bb4c8fb3-ff8b-433f-a32a-90bf7a5eb40f response_code = 200 uri = /baseboard
25022025-01-22T09:31:10.560ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6751 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = e78c42ab-4da0-45e6-8ef0-3afd9db85e65 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
25032025-01-22T09:31:29.643ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45880
25042025-01-22T09:31:29.643ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45880 req_id = d501c756-24cb-41d6-a3b9-026f3ca85de4 response_code = 200 uri = /vpc-routes
25052025-01-22T09:31:29.687ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
25062025-01-22T09:31:29.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45880 req_id = afd179f9-f019-437e-821a-1d337d90e6c1 response_code = 204 uri = /eip-gateways
25072025-01-22T09:31:29.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36375
25082025-01-22T09:31:29.729ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36375 req_id = 18f50e20-2465-47b7-b3dc-376030b9924f response_code = 200 uri = /v2p
25092025-01-22T09:31:29.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:45880 req_id = 0e8a7e0c-a532-4108-ab52-f2aac7d84208 response_code = 204 uri = /vpc-routes
25102025-01-22T09:31:29.791ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62150
25112025-01-22T09:31:29.791ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25122025-01-22T09:31:29.833ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25132025-01-22T09:31:29.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133795 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:62150 req_id = 4ce732ee-a86c-4ef5-819c-2d1f1bc1bca0 response_code = 204 uri = /switch-ports
25142025-01-22T09:31:29.925ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62150 req_id = e48e8b74-c02c-4290-be7e-92debd736776 response_code = 200 uri = /network-bootstore-config
25152025-01-22T09:31:30.021ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57701
25162025-01-22T09:31:30.022ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57701 req_id = 7ebc1d81-8cd2-4d7a-9fb8-0bac3dfebc2e response_code = 200 uri = /vpc-routes
25172025-01-22T09:31:30.085ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
25182025-01-22T09:31:30.086ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57701 req_id = c7a4a5e1-6600-4b63-b935-aac84909075a response_code = 204 uri = /eip-gateways
25192025-01-22T09:31:30.104ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:57701 req_id = 720102c7-57ba-41f2-87c5-cf7c81263b7d response_code = 204 uri = /vpc-routes
25202025-01-22T09:31:30.110ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32828
25212025-01-22T09:31:30.110ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25222025-01-22T09:31:30.156ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25232025-01-22T09:31:30.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107382 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:32828 req_id = 7192486f-d745-4342-b50d-c558911456f9 response_code = 204 uri = /switch-ports
25242025-01-22T09:31:30.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33398
25252025-01-22T09:31:30.218ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47335
25262025-01-22T09:31:30.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33398 req_id = 139d2574-56d8-4389-ba3f-cbd38bf56530 response_code = 200 uri = /v2p
25272025-01-22T09:31:30.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32828 req_id = d32a54f8-7ea6-4e89-be11-8129575d58a5 response_code = 200 uri = /network-bootstore-config
25282025-01-22T09:31:30.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47335 req_id = cdaae51e-b648-4d01-82d2-5177fe82151d response_code = 200 uri = /vpc-routes
25292025-01-22T09:31:30.265ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
25302025-01-22T09:31:30.265ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47335 req_id = 51529461-3565-4aca-b7a1-8a47ece99828 response_code = 204 uri = /eip-gateways
25312025-01-22T09:31:30.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47335 req_id = d8a553c4-1943-4b15-addc-5d0ee5be9049 response_code = 204 uri = /vpc-routes
25322025-01-22T09:31:30.437ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40662
25332025-01-22T09:31:30.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 163 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40662 req_id = a9fbe886-d1db-4bb8-bda6-a12adce15d55 response_code = 200 uri = /v2p
25342025-01-22T09:31:30.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59614
25352025-01-22T09:31:30.480ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25362025-01-22T09:31:30.519ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25372025-01-22T09:31:30.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94834 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:59614 req_id = 66de6ebd-cdb8-411d-84e9-485c09f97308 response_code = 204 uri = /switch-ports
25382025-01-22T09:31:30.575ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59614 req_id = 9561a13b-1078-421d-9d1e-acb131f96320 response_code = 200 uri = /network-bootstore-config
25392025-01-22T09:31:40.158ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47985
25402025-01-22T09:31:40.158ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47985 req_id = ece05f36-abb4-4696-94e6-a6ece45b93fc response_code = 200 uri = /baseboard
25412025-01-22T09:31:40.559ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6542 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = c8c0c03b-4eae-42a6-9a07-332a41456c93 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
25422025-01-22T09:31:59.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65120
25432025-01-22T09:31:59.898ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65120 req_id = 145b9277-6dc8-4956-a461-71ba2c82af15 response_code = 200 uri = /vpc-routes
25442025-01-22T09:31:59.975ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
25452025-01-22T09:31:59.975ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65120 req_id = 9813dafe-6638-42e7-812f-bd2620a1bf22 response_code = 204 uri = /eip-gateways
25462025-01-22T09:31:59.981ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:43246
25472025-01-22T09:31:59.981ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 152 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:43246 req_id = bb72da1c-fe60-461b-a671-772cd676307c response_code = 200 uri = /v2p
25482025-01-22T09:31:59.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 361 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:65120 req_id = 1b4e95d7-fe50-4b15-9dec-86cb0d206412 response_code = 204 uri = /vpc-routes
25492025-01-22T09:32:00.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59852
25502025-01-22T09:32:00.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25512025-01-22T09:32:00.073ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25522025-01-22T09:32:00.073ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:177
25532025-01-22T09:32:00.074ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:177
25542025-01-22T09:32:00.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:40391
25552025-01-22T09:32:00.083ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25562025-01-22T09:32:00.093ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25572025-01-22T09:32:00.093ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5aeeec4-0c1c-45d8-941a-82b993064243
25582025-01-22T09:32:00.131ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25592025-01-22T09:32:00.131ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_34031fe8-4691-4be6-a0d4-bb1591795113
25602025-01-22T09:32:00.139ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25612025-01-22T09:32:00.169ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25622025-01-22T09:32:00.169ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3
25632025-01-22T09:32:00.193ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39349
25642025-01-22T09:32:00.194ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25652025-01-22T09:32:00.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25662025-01-22T09:32:00.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25672025-01-22T09:32:00.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25682025-01-22T09:32:00.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
25692025-01-22T09:32:00.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25702025-01-22T09:32:00.194ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25712025-01-22T09:32:00.194ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 848 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:39349 req_id = d403d5ce-05bd-4ab2-ac21-124fb0858004 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25722025-01-22T09:32:00.207ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25732025-01-22T09:32:00.207ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38
25742025-01-22T09:32:00.231ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 148455 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:40391 req_id = ffe3d774-7f9c-4620-9793-39a6e43ef279 response_code = 204 uri = /switch-ports
25752025-01-22T09:32:00.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 297 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:40391 req_id = 425f4a8e-2d22-4177-bdb8-0f41aacb188f response_code = 200 uri = /network-bootstore-config
25762025-01-22T09:32:00.241ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25772025-01-22T09:32:00.241ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750
25782025-01-22T09:32:00.269ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25792025-01-22T09:32:00.269ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbff868b-4199-4969-b27b-36834c92fe00
25802025-01-22T09:32:00.295ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25812025-01-22T09:32:00.295ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8
25822025-01-22T09:32:00.317ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25832025-01-22T09:32:00.317ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8
25842025-01-22T09:32:00.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38868
25852025-01-22T09:32:00.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38868 req_id = 0a10c474-61d1-4e1c-8e9e-e90eb38f7aa5 response_code = 200 uri = /vpc-routes
25862025-01-22T09:32:00.341ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25872025-01-22T09:32:00.341ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dad37219-37a0-41c1-b1d5-db92f039358b
25882025-01-22T09:32:00.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 286656 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59852 req_id = e14e663c-1051-4a55-8157-182a162fdb12 response_code = 200 uri = /inventory
25892025-01-22T09:32:00.370ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
25902025-01-22T09:32:00.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38868 req_id = c23013e4-5e02-45ea-b96c-449bd8086966 response_code = 204 uri = /eip-gateways
25912025-01-22T09:32:00.414ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60956
25922025-01-22T09:32:00.415ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60956 req_id = 2c91989d-8c66-4511-87ef-e7a4372d4f8f response_code = 200 uri = /v2p
25932025-01-22T09:32:00.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41914
25942025-01-22T09:32:00.440ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25952025-01-22T09:32:00.440ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25962025-01-22T09:32:00.440ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:177
25972025-01-22T09:32:00.441ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:177
25982025-01-22T09:32:00.450ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 466 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38868 req_id = c462c8ab-ecba-482a-9822-de769bb33acf response_code = 204 uri = /vpc-routes
25992025-01-22T09:32:00.454ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26002025-01-22T09:32:00.454ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5aeeec4-0c1c-45d8-941a-82b993064243
26012025-01-22T09:32:00.459ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35478
26022025-01-22T09:32:00.459ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26032025-01-22T09:32:00.484ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26042025-01-22T09:32:00.484ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_34031fe8-4691-4be6-a0d4-bb1591795113
26052025-01-22T09:32:00.505ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60437
26062025-01-22T09:32:00.506ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44228
26072025-01-22T09:32:00.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44228 req_id = fb855755-963c-4d3c-a253-2d1dc15e49c0 response_code = 200 uri = /vpc-routes
26082025-01-22T09:32:00.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60437 req_id = aa0b3cff-e775-42a2-a136-712fd29875d9 response_code = 200 uri = /v2p
26092025-01-22T09:32:00.506ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26102025-01-22T09:32:00.514ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26112025-01-22T09:32:00.515ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3
26122025-01-22T09:32:00.545ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26132025-01-22T09:32:00.545ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38
26142025-01-22T09:32:00.559ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
26152025-01-22T09:32:00.559ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 667 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44228 req_id = 1e19b58f-80c5-4d32-bd94-b337bd8881f8 response_code = 204 uri = /eip-gateways
26162025-01-22T09:32:00.573ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4931 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44228 req_id = 362f7f08-b8bb-4557-96c0-16684d402d85 response_code = 204 uri = /vpc-routes
26172025-01-22T09:32:00.574ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26182025-01-22T09:32:00.574ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750
26192025-01-22T09:32:00.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35478 req_id = dfe02c8d-d5ff-44c2-945a-40c92c77a709 response_code = 204 uri = /switch-ports
26202025-01-22T09:32:00.582ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35478 req_id = 02a8e09d-9198-49e2-827f-93bb5030969e response_code = 200 uri = /network-bootstore-config
26212025-01-22T09:32:00.601ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26222025-01-22T09:32:00.601ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbff868b-4199-4969-b27b-36834c92fe00
26232025-01-22T09:32:00.625ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62949
26242025-01-22T09:32:00.625ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26252025-01-22T09:32:00.626ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26262025-01-22T09:32:00.626ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42d2a693-a856-441a-b467-e7857d30832a/config/omicron-zones.json file = common/src/ledger.rs:177
26272025-01-22T09:32:00.626ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/config/omicron-zones.json file = common/src/ledger.rs:177
26282025-01-22T09:32:00.639ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26292025-01-22T09:32:00.639ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8
26302025-01-22T09:32:00.652ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b5aeeec4-0c1c-45d8-941a-82b993064243 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26312025-01-22T09:32:00.652ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b5aeeec4-0c1c-45d8-941a-82b993064243
26322025-01-22T09:32:00.678ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47119
26332025-01-22T09:32:00.678ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26342025-01-22T09:32:00.683ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 34031fe8-4691-4be6-a0d4-bb1591795113 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26352025-01-22T09:32:00.683ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_34031fe8-4691-4be6-a0d4-bb1591795113
26362025-01-22T09:32:00.698ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26372025-01-22T09:32:00.698ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8
26382025-01-22T09:32:00.702ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45959
26392025-01-22T09:32:00.712ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26402025-01-22T09:32:00.712ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26412025-01-22T09:32:00.712ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26422025-01-22T09:32:00.712ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26432025-01-22T09:32:00.712ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26442025-01-22T09:32:00.712ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26452025-01-22T09:32:00.712ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26462025-01-22T09:32:00.712ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 953 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45959 req_id = e3aaf879-543b-4fe9-8f06-21dac5930141 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26472025-01-22T09:32:00.717ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 5a89a118-2a6b-4435-9092-d6dd78aea2e3 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26482025-01-22T09:32:00.717ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_5a89a118-2a6b-4435-9092-d6dd78aea2e3
26492025-01-22T09:32:00.722ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26502025-01-22T09:32:00.728ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33323
26512025-01-22T09:32:00.728ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 49f4eaec-dfdf-4dbf-aa42-6362549a17f3, kind: Service { id: 15ee210a-dadf-4d23-a47a-a8053915b9bf }, name: Name("external-dns-15ee210a-dadf-4d23-a47a-a8053915b9bf"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 231])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d9eead72-2119-4045-98bf-852dad818643, kind: Service { id: 0dd41a65-6ea3-470b-8245-29da2ae7befa }, name: Name("external-dns-0dd41a65-6ea3-470b-8245-29da2ae7befa"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 149, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 0e526158-c71c-47d5-a50e-80a00133fa2d, kind: Service { id: 2f493885-1d8e-4f10-aa89-9f2b6aebd598 }, name: Name("nexus-2f493885-1d8e-4f10-aa89-9f2b6aebd598"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 236])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 51617a98-c214-423a-aea7-ca0f5fa6c94b, kind: Service { id: f355370f-27f8-480f-a075-c338511729ae }, name: Name("nexus-f355370f-27f8-480f-a075-c338511729ae"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 102])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: d6be21fe-92bf-497d-b532-15ff9df6c0f4, kind: Service { id: 8cc5eb46-08bb-4d00-8d2e-18a0e40c58df }, name: Name("nexus-8cc5eb46-08bb-4d00-8d2e-18a0e40c58df"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 251, 13])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26522025-01-22T09:32:00.728ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26532025-01-22T09:32:00.728ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26542025-01-22T09:32:00.728ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26552025-01-22T09:32:00.728ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26562025-01-22T09:32:00.728ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26572025-01-22T09:32:00.728ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26582025-01-22T09:32:00.728ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 638 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:33323 req_id = ba752805-935d-4406-afab-7b27ec6bf3df response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26592025-01-22T09:32:00.734ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26602025-01-22T09:32:00.734ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dad37219-37a0-41c1-b1d5-db92f039358b
26612025-01-22T09:32:00.758ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 317793 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41914 req_id = 588c43d0-ccfa-4a8f-9582-81c4dabef193 response_code = 200 uri = /inventory
26622025-01-22T09:32:00.760ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: b03e8f4b-60f0-4c52-958e-2f9571749b38 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26632025-01-22T09:32:00.760ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_b03e8f4b-60f0-4c52-958e-2f9571749b38
26642025-01-22T09:32:00.782ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4091af72-7d1b-4529-85f2-2ca5bec8f750 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26652025-01-22T09:32:00.783ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4091af72-7d1b-4529-85f2-2ca5bec8f750
26662025-01-22T09:32:00.791ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113221 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:47119 req_id = 09511b23-e596-46c4-8ed8-79693223c1e9 response_code = 204 uri = /switch-ports
26672025-01-22T09:32:00.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 132 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:47119 req_id = 7b00436c-0514-470a-be18-380f0afeec6a response_code = 200 uri = /network-bootstore-config
26682025-01-22T09:32:00.807ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: bbff868b-4199-4969-b27b-36834c92fe00 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26692025-01-22T09:32:00.807ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_bbff868b-4199-4969-b27b-36834c92fe00
26702025-01-22T09:32:00.833ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 2be08399-4b95-4cf8-9177-fa1c2f515fe8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26712025-01-22T09:32:00.833ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_2be08399-4b95-4cf8-9177-fa1c2f515fe8
26722025-01-22T09:32:00.857ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 4d61fa00-ad5f-402c-81cb-e2f6c41f28d8 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26732025-01-22T09:32:00.857ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_4d61fa00-ad5f-402c-81cb-e2f6c41f28d8
26742025-01-22T09:32:00.885ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: dad37219-37a0-41c1-b1d5-db92f039358b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26752025-01-22T09:32:00.885ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_dad37219-37a0-41c1-b1d5-db92f039358b
26762025-01-22T09:32:00.900ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 274728 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62949 req_id = 2fa5272d-52d7-4c01-a40a-af45723d618e response_code = 200 uri = /inventory
26772025-01-22T09:32:10.191ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40781
26782025-01-22T09:32:10.191ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 31 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40781 req_id = 839f8a9c-b6fa-4f89-9cf7-2022ccb53860 response_code = 200 uri = /baseboard
26792025-01-22T09:32:10.560ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7975 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = b14fa83d-92d7-4aa5-b8da-1963c2c00152 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
26802025-01-22T09:32:29.657ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59536
26812025-01-22T09:32:29.657ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:59536 req_id = ac3214fa-1413-4baf-a08f-f8a497046283 response_code = 200 uri = /vpc-routes
26822025-01-22T09:32:29.717ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
26832025-01-22T09:32:29.717ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59536 req_id = eb5d9736-37b7-40d6-90eb-7c0c07906847 response_code = 204 uri = /eip-gateways
26842025-01-22T09:32:29.726ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 261 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59536 req_id = 3857d2ee-8253-4c40-b5c5-b8c41f19edd1 response_code = 204 uri = /vpc-routes
26852025-01-22T09:32:29.858ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62322
26862025-01-22T09:32:29.858ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:62322 req_id = b9e10b7f-ab70-491a-a8a7-16305fb27c07 response_code = 200 uri = /v2p
26872025-01-22T09:32:29.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57850
26882025-01-22T09:32:29.886ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26892025-01-22T09:32:29.932ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26902025-01-22T09:32:29.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105923 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57850 req_id = 761ff24a-f858-4606-b92d-6b6ce2555797 response_code = 204 uri = /switch-ports
26912025-01-22T09:32:29.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57850 req_id = b36cf237-5811-46e2-93ba-2812951f178f response_code = 200 uri = /network-bootstore-config
26922025-01-22T09:32:30.147ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:60389
26932025-01-22T09:32:30.147ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:60389 req_id = 5ea6b0b0-4c47-4fff-acd0-c18a1965da2e response_code = 200 uri = /vpc-routes
26942025-01-22T09:32:30.192ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
26952025-01-22T09:32:30.192ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60389 req_id = c2314cd2-a352-4188-9920-77aa5df03b28 response_code = 204 uri = /eip-gateways
26962025-01-22T09:32:30.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 241 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:60389 req_id = 6e14e891-61aa-4054-8f44-ae7368fc7c58 response_code = 204 uri = /vpc-routes
26972025-01-22T09:32:30.206ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44505
26982025-01-22T09:32:30.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44505 req_id = 9eb8d8d6-b1ab-4ae2-a1da-30b08bd810e2 response_code = 200 uri = /vpc-routes
26992025-01-22T09:32:30.220ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
27002025-01-22T09:32:30.220ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44505 req_id = 308cd126-8910-4df0-b725-a30ab23876e8 response_code = 204 uri = /eip-gateways
27012025-01-22T09:32:30.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:53537
27022025-01-22T09:32:30.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:53537 req_id = 931cdb99-21e6-47ed-a78c-3a5e928d2970 response_code = 200 uri = /v2p
27032025-01-22T09:32:30.229ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44505 req_id = 7076d688-6102-4ab2-97c8-330514b59042 response_code = 204 uri = /vpc-routes
27042025-01-22T09:32:30.245ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:49697
27052025-01-22T09:32:30.246ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27062025-01-22T09:32:30.285ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27072025-01-22T09:32:30.343ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97848 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:49697 req_id = 59755a7f-be8b-4d46-bcfb-1d15367f3173 response_code = 204 uri = /switch-ports
27082025-01-22T09:32:30.343ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57277
27092025-01-22T09:32:30.344ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:33699
27102025-01-22T09:32:30.344ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27112025-01-22T09:32:30.344ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 310 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:49697 req_id = 18d53a93-b3f2-454d-ab03-b92e9fae9db0 response_code = 200 uri = /network-bootstore-config
27122025-01-22T09:32:30.348ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3984 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:33699 req_id = 5e51c2ce-25f2-46da-abc6-2b4e5df8e6a9 response_code = 200 uri = /v2p
27132025-01-22T09:32:30.385ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27142025-01-22T09:32:30.442ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57277 req_id = da117389-23fa-4103-b1d6-858402ff5694 response_code = 204 uri = /switch-ports
27152025-01-22T09:32:30.443ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57277 req_id = ef41ed68-2ac4-4ec2-8c7b-e06664e579c4 response_code = 200 uri = /network-bootstore-config
27162025-01-22T09:32:33.288ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58224
27172025-01-22T09:32:33.289ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 211 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58224 req_id = d4935874-b4d8-4055-ba13-536ddc1530e9 response_code = 200 uri = /v2p
27182025-01-22T09:32:33.291ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(108650) }
27192025-01-22T09:32:33.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:58224 req_id = 4e79c849-1d9d-4633-be8f-254606a31c3c response_code = 204 uri = /v2p
27202025-01-22T09:32:33.386ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:62908
27212025-01-22T09:32:33.395ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5fce6c7b-54da-484b-ac0e-1a9da20fba55, kind: Instance { id: 50d5be21-e603-4495-9d57-fd16a3926a88 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(108650), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5fce6c7b-54da-484b-ac0e-1a9da20fba55, kind: Instance { id: 50d5be21-e603-4495-9d57-fd16a3926a88 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(108650), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5fce6c7b-54da-484b-ac0e-1a9da20fba55, kind: Instance { id: 50d5be21-e603-4495-9d57-fd16a3926a88 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(108650), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(108650))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5fce6c7b-54da-484b-ac0e-1a9da20fba55, kind: Instance { id: 50d5be21-e603-4495-9d57-fd16a3926a88 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(108650), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ac057481-7d1c-4bde-b9f0-f867370bdc1d, slot: 0, read_only: false, vcr_json: .., name: "disk-52f3abea898" }], boot_settings: Some(InstanceBootSettings { order: [ac057481-7d1c-4bde-b9f0-f867370bdc1d] }), cloud_init_bytes: Some(..) } instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 metadata = InstanceMetadata { silo_id: 43ca547c-fd58-4d5d-8cd1-8a271138b893, project_id: 6578dd00-e975-4632-afc0-d1643e61e387 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-22T09:32:33.385836545Z }
27222025-01-22T09:32:33.395ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 migration_id = None propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27232025-01-22T09:32:33.395ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 migration_id = None propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 5fce6c7b-54da-484b-ac0e-1a9da20fba55, kind: Instance { id: 50d5be21-e603-4495-9d57-fd16a3926a88 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(108650), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5fce6c7b-54da-484b-ac0e-1a9da20fba55, kind: Instance { id: 50d5be21-e603-4495-9d57-fd16a3926a88 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(108650), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5fce6c7b-54da-484b-ac0e-1a9da20fba55, kind: Instance { id: 50d5be21-e603-4495-9d57-fd16a3926a88 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(108650), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(108650))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 5fce6c7b-54da-484b-ac0e-1a9da20fba55, kind: Instance { id: 50d5be21-e603-4495-9d57-fd16a3926a88 }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(108650), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: ac057481-7d1c-4bde-b9f0-f867370bdc1d, slot: 0, read_only: false, vcr_json: .., name: "disk-52f3abea898" }], boot_settings: Some(InstanceBootSettings { order: [ac057481-7d1c-4bde-b9f0-f867370bdc1d] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-22T09:32:33.385836545Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27242025-01-22T09:32:33.396ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 10620 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:62908 req_id = 6100d3fc-96fa-4f09-8a29-83a9d9323a99 response_code = 200 uri = /vmms/99916f8f-4296-4b69-b815-af39da611ed8
27252025-01-22T09:32:33.497ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38854
27262025-01-22T09:32:33.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 832 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:38854 req_id = ec87db7a-8ada-496c-93fc-a9b9668dc3bd response_code = 200 uri = /vmms/99916f8f-4296-4b69-b815-af39da611ed8/state
27272025-01-22T09:32:33.499ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 108650 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27282025-01-22T09:32:33.499ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27292025-01-22T09:32:33.541ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8 file = illumos-utils/src/zone.rs:325 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27302025-01-22T09:32:33.568ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8 file = illumos-utils/src/zone.rs:363 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27312025-01-22T09:32:33.631ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46172
27322025-01-22T09:32:33.631ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46172 req_id = a7f4c3a6-be7a-4d87-b88f-a1c56ed9bd66 response_code = 200 uri = /vpc-routes
27332025-01-22T09:32:33.649ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {5fce6c7b-54da-484b-ac0e-1a9da20fba55: {10.151.2.176: {ace70ae1-f896-420c-9077-7df614018a3c}, 10.151.2.175: {ace70ae1-f896-420c-9077-7df614018a3c}}} }
27342025-01-22T09:32:35.046ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27352025-01-22T09:32:35.046ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8 zone file = illumos-utils/src/running_zone.rs:488 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 zone = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27362025-01-22T09:32:35.262ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 25.793715ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 zone = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27372025-01-22T09:32:35.297ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 117.770048ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 zone = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27382025-01-22T09:32:35.436ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 181.980464ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 zone = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27392025-01-22T09:32:35.632ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 582.426623ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 zone = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27402025-01-22T09:32:36.231ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 914.362559ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 zone = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27412025-01-22T09:32:37.157ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 989.985442ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 zone = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27422025-01-22T09:32:38.158ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 1.063542084s file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 zone = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27432025-01-22T09:32:39.232ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 961.074717ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 zone = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27442025-01-22T09:32:40.225ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47397
27452025-01-22T09:32:40.225ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47397 req_id = 251f51ac-bfed-43f3-9d1e-77c60f4c7b42 response_code = 200 uri = /baseboard
27462025-01-22T09:32:40.234ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8 file = sled-agent/src/instance.rs:2068 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27472025-01-22T09:32:40.245ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 36.276509ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27482025-01-22T09:32:40.291ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 111.975025ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27492025-01-22T09:32:40.417ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 152.636497ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27502025-01-22T09:32:40.565ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 12469 local_addr = [fd00:1122:3344:101::1]:34317 method = GET remote_addr = [fd00:1122:3344:101::d]:62315 req_id = a0a31058-66f8-4064-adf3-80519058c4e4 response_code = 200 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 uri = /02eb3679-08e1-4d9d-a221-e5b8fe419fb5
27512025-01-22T09:32:40.581ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8") failed: Property not found. retry in 346.903598ms file = illumos-utils/src/svc.rs:42 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27522025-01-22T09:32:40.940ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27532025-01-22T09:32:40.976ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27542025-01-22T09:32:41.115ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27552025-01-22T09:32:41.115ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
27562025-01-22T09:32:41.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7466437 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46172 req_id = 392e1b15-139b-4840-872d-d9ecfbe21164 response_code = 204 uri = /eip-gateways
27572025-01-22T09:32:41.116ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-22T09:32:41.116499223Z } file = sled-agent/src/instance.rs:781 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27582025-01-22T09:32:41.116ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-22T09:32:41.116499223Z } propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27592025-01-22T09:32:41.116ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-22T09:32:41.116499223Z }, migration_in: None, migration_out: None }
27602025-01-22T09:32:41.150ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-22T09:32:41.150367237Z } file = sled-agent/src/instance.rs:781 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27612025-01-22T09:32:41.150ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-22T09:32:41.150367237Z } propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27622025-01-22T09:32:41.150ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-22T09:32:41.150367237Z }, migration_in: None, migration_out: None }
27632025-01-22T09:32:41.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 526 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46172 req_id = 74f7b719-aae5-4464-b80c-ecc81debcb34 response_code = 204 uri = /vpc-routes
27642025-01-22T09:32:51.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35025
27652025-01-22T09:32:51.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 524 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:35025 req_id = 67bbe247-cff2-4031-9482-436dbd25950d response_code = 200 uri = /vmms/99916f8f-4296-4b69-b815-af39da611ed8/state
27662025-01-22T09:32:51.173ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-22T09:32:51.173742447Z } file = sled-agent/src/instance.rs:781 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27672025-01-22T09:32:51.173ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-22T09:32:51.173742447Z } propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27682025-01-22T09:32:51.173ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-22T09:32:51.173742447Z }, migration_in: None, migration_out: None }
27692025-01-22T09:32:51.188ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-22T09:32:51.188002180Z } file = sled-agent/src/instance.rs:781 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27702025-01-22T09:32:51.188ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-22T09:32:51.188002180Z } propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27712025-01-22T09:32:51.188ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27722025-01-22T09:32:51.188ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27732025-01-22T09:32:51.188ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 14890672532592327177 n_samples = 6 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
27742025-01-22T09:32:51.188ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 935013118034790005 n_samples = 6 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
27752025-01-22T09:32:51.188ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27762025-01-22T09:32:51.188ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/42d2a693-a856-441a-b467-e7857d30832a/debug/bundle/zone", "/pool/int/bc204009-2b70-4bf6-9876-723a32c6c100/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/b5aeeec4-0c1c-45d8-941a-82b993064243/crypt/debug", "/pool/ext/34031fe8-4691-4be6-a0d4-bb1591795113/crypt/debug", "/pool/ext/5a89a118-2a6b-4435-9092-d6dd78aea2e3/crypt/debug", "/pool/ext/b03e8f4b-60f0-4c52-958e-2f9571749b38/crypt/debug", "/pool/ext/4091af72-7d1b-4529-85f2-2ca5bec8f750/crypt/debug", "/pool/ext/bbff868b-4199-4969-b27b-36834c92fe00/crypt/debug", "/pool/ext/2be08399-4b95-4cf8-9177-fa1c2f515fe8/crypt/debug", "/pool/ext/4d61fa00-ad5f-402c-81cb-e2f6c41f28d8/crypt/debug", "/pool/ext/dad37219-37a0-41c1-b1d5-db92f039358b/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8
27772025-01-22T09:32:51.817ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8", bundle_id: 61b126b8-617a-44b6-bb13-feabd4428d51 }, time_created: 2025-01-22T09:32:51.189028991Z, version: 0, cause: TerminatedInstance }
27782025-01-22T09:32:51.818ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_99916f8f-4296-4b69-b815-af39da611ed8 file = sled-agent/src/instance.rs:1314 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27792025-01-22T09:32:53.579ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27802025-01-22T09:32:53.597ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(108650), kind: System }
27812025-01-22T09:32:53.597ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(108650), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
27822025-01-22T09:32:53.599ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-22T09:32:53.599142904Z }, migration_in: None, migration_out: None }
27832025-01-22T09:32:53.623ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-22T09:32:53.599142904Z }, migration_in: None, migration_out: None }
27842025-01-22T09:32:53.627ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = 50d5be21-e603-4495-9d57-fd16a3926a88 propolis_id = 99916f8f-4296-4b69-b815-af39da611ed8
27852025-01-22T09:32:53.977ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55258
27862025-01-22T09:32:53.977ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55258 req_id = 511a5690-7458-4bed-9e0a-02ea09bd45ad response_code = 200 uri = /vpc-routes
27872025-01-22T09:32:53.992ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {5fce6c7b-54da-484b-ac0e-1a9da20fba55: {10.151.2.176: {ace70ae1-f896-420c-9077-7df614018a3c}, 10.151.2.175: {ace70ae1-f896-420c-9077-7df614018a3c}}} }
27882025-01-22T09:32:53.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55258 req_id = b07aa7d3-7d22-4caa-9899-ef7005b09997 response_code = 204 uri = /eip-gateways
27892025-01-22T09:32:54.019ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:52445
27902025-01-22T09:32:54.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 122 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:52445 req_id = e4447146-64c5-49de-a6b8-ce2ef4691ef1 response_code = 200 uri = /v2p
27912025-01-22T09:32:54.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55258 req_id = 205277cc-161a-4c45-950b-db16d8813ba5 response_code = 204 uri = /vpc-routes
27922025-01-22T09:32:54.295ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:45356
27932025-01-22T09:32:54.295ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:45356 req_id = 35b5f51a-c627-44b1-890b-0bc5c129c2d9 response_code = 200 uri = /v2p
27942025-01-22T09:32:54.385ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46607
27952025-01-22T09:32:54.385ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46607 req_id = 3e7e00fd-e38e-4f75-a7f1-530fe6827037 response_code = 200 uri = /vpc-routes
27962025-01-22T09:32:54.399ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
27972025-01-22T09:32:54.399ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5
27982025-01-22T09:32:54.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 176 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46607 req_id = 299268c0-e376-459a-ad57-b34ccb25d424 response_code = 204 uri = /eip-gateways
27992025-01-22T09:32:54.407ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 379 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46607 req_id = 828ef119-c9fb-4142-bd52-4188f7ada76c response_code = 204 uri = /vpc-routes
28002025-01-22T09:32:55.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37330
28012025-01-22T09:32:55.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37330 req_id = 1223bd13-3f27-4b89-af21-7e5b8afbc6d2 response_code = 200 uri = /vpc-routes
28022025-01-22T09:32:55.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = 02eb3679-08e1-4d9d-a221-e5b8fe419fb5 values = ExternalIpGatewayMap { mappings: {} }
28032025-01-22T09:32:55.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37330 req_id = d81cf92f-432f-43ca-b388-9d1eb31deddb response_code = 204 uri = /eip-gateways
28042025-01-22T09:32:55.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 203 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37330 req_id = 9bfe4294-95e7-4869-b662-78b91438970b response_code = 204 uri = /vpc-routes