Max level shown:
1 [ Jan 17 08:20:07 Enabled. ]
2 [ Jan 17 08:20:07 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/sled-agent/sled-agent run /opt/oxide/sled-agent/pkg/config.toml &"). ]
3 [ Jan 17 08:20:07 Method "start" exited with status 0. ]
4 [ Jan 17 08:20:07 Rereading configuration. ]
5 [ Jan 17 08:20:07 No 'refresh' method defined. Treating as :true. ]
6 note: configured to log to "/dev/stdout"
72025-01-17T08:20:07.839ZINFOSledAgent: Ensuring contract reaper thread file = illumos-utils/src/running_zone.rs:113
82025-01-17T08:20:07.840ZINFOSledAgent (BootstrapAgentStartup): finding links ["net0", "net1"] file = sled-agent/src/bootstrap/pre_server.rs:255
92025-01-17T08:20:07.893ZINFOSledAgent (BootstrapAgentStartup): Starting mg-ddm service addr-objs = [AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }] file = sled-agent/src/bootstrap/pre_server.rs:262
102025-01-17T08:20:07.893ZINFOSledAgent (BootstrapAgentStartup): Importing mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:42 path = /opt/oxide/mg-ddm/pkg/ddm/manifest.xml
112025-01-17T08:20:08.009ZINFOSledAgent (BootstrapAgentStartup): Setting mg-ddm interfaces file = sled-agent/src/bootstrap/maghemite.rs:50 interfaces = ("net0/ll" "net1/ll")
122025-01-17T08:20:08.018ZINFOSledAgent (BootstrapAgentStartup): Enabling mg-ddm service file = sled-agent/src/bootstrap/maghemite.rs:56
132025-01-17T08:20:08.026ZINFOSledAgent (BootstrapAgentStartup): Ensuring zfs key directory exists file = sled-agent/src/bootstrap/pre_server.rs:272 path = /var/run/oxide/
142025-01-17T08:20:08.637ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fdb0:18c0:4d0d:a02a::, width: 64 }
152025-01-17T08:20:08.778ZINFOSledAgent: Starting KeyManager file = sled-agent/src/long_running_tasks.rs:126
162025-01-17T08:20:08.778ZINFOSledAgent: Starting StorageManager file = sled-agent/src/long_running_tasks.rs:138
172025-01-17T08:20:08.778ZINFOSledAgent: Starting StorageMonitor file = sled-agent/src/long_running_tasks.rs:151
182025-01-17T08:20:08.778ZINFOSledAgent: Starting HardwareManager file = sled-agent/src/long_running_tasks.rs:173 nongimlet_observed_disks = [] sled_mode = Scrimlet { asic: SoftNpuZone }
192025-01-17T08:20:08.778ZINFOSledAgent (HardwareManager): Creating HardwareManager file = sled-hardware/src/illumos/mod.rs:717
202025-01-17T08:20:08.778ZINFOSledAgent (DumpSetup-worker): DumpSetup poll loop started. file = sled-agent/src/dump_setup.rs:520
212025-01-17T08:20:08.781ZINFOSledAgent (HardwareManager): Generated i86pc baseboard Pc { identifier: "sock", model: "i86pc" } file = sled-hardware/src/illumos/mod.rs:624
222025-01-17T08:20:08.781ZWARNSledAgent (HardwareManager): Device is not a Gimlet (i86pc), proceeding with null hardware view file = sled-hardware/src/illumos/mod.rs:766
232025-01-17T08:20:08.781ZINFOSledAgent: Starting HardwareMonitor file = sled-agent/src/long_running_tasks.rs:187
242025-01-17T08:20:08.781ZINFOSledAgent (HardwareManager): Monitoring for hardware updates file = sled-hardware/src/illumos/mod.rs:825
252025-01-17T08:20:08.781ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_0.vdev
262025-01-17T08:20:08.781ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = None
272025-01-17T08:20:08.781ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
282025-01-17T08:20:08.781ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
292025-01-17T08:20:08.781ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } path = /scratch/m2_0.vdev
302025-01-17T08:20:08.792ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_0.vdev file = sled-hardware/src/disk.rs:367
312025-01-17T08:20:08.792ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool)
322025-01-17T08:20:08.889ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal }
332025-01-17T08:20:09.247ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
342025-01-17T08:20:09.247ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/m2_1.vdev
352025-01-17T08:20:09.247ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
362025-01-17T08:20:09.247ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
372025-01-17T08:20:09.247ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
382025-01-17T08:20:09.247ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
392025-01-17T08:20:09.247ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } path = /scratch/m2_1.vdev
402025-01-17T08:20:09.255ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/m2_1.vdev file = sled-hardware/src/disk.rs:367
412025-01-17T08:20:09.255ZINFOSledAgent (StorageResources): Formatting zpool with generated ID file = sled-hardware/src/disk.rs:378 id = 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool)
422025-01-17T08:20:09.347ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal }
432025-01-17T08:20:09.707ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_0.vdev
442025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
452025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
462025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
472025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
482025-01-17T08:20:09.707ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
492025-01-17T08:20:09.707ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_1.vdev
502025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
512025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
522025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
532025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
542025-01-17T08:20:09.707ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
552025-01-17T08:20:09.707ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_2.vdev
562025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
572025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
582025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
592025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
602025-01-17T08:20:09.707ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
612025-01-17T08:20:09.707ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_3.vdev
622025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
632025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
642025-01-17T08:20:09.707ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
652025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
662025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
672025-01-17T08:20:09.707ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_4.vdev
682025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
692025-01-17T08:20:09.707ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
702025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
712025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
722025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
732025-01-17T08:20:09.707ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_5.vdev
742025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
752025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
762025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
772025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
782025-01-17T08:20:09.707ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
792025-01-17T08:20:09.707ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_6.vdev
802025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
812025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
822025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
832025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
842025-01-17T08:20:09.707ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
852025-01-17T08:20:09.707ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_7.vdev
862025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
872025-01-17T08:20:09.707ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
882025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
892025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
902025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
912025-01-17T08:20:09.707ZINFOSledAgent: Upserting synthetic device to Storage Manager file = sled-agent/src/long_running_tasks.rs:243 vdev = /scratch/u2_8.vdev
922025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received DetectedRawDisk { raw_disk: Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }), tx: ... } file = sled-storage/src/manager.rs:607
932025-01-17T08:20:09.707ZINFOSledAgent (StorageResources): Inserting disk file = sled-storage/src/resources.rs:457 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
942025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
952025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
962025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
972025-01-17T08:20:09.707ZINFOSledAgent: Waiting for boot disk file = sled-agent/src/long_running_tasks.rs:97
982025-01-17T08:20:09.707ZINFOSledAgent: Found boot disk DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" } file = sled-agent/src/long_running_tasks.rs:99
992025-01-17T08:20:09.707ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(1), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: Unmanaged(Synthetic(RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
1002025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
1012025-01-17T08:20:09.707ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
1022025-01-17T08:20:09.707ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1032025-01-17T08:20:09.707ZINFOSledAgent: Starting Bootstore file = sled-agent/src/long_running_tasks.rs:211
1042025-01-17T08:20:09.708ZINFOSledAgent (bootstore): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1052025-01-17T08:20:09.708ZINFOSledAgent (bootstore): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/cluster/bootstore-fsm-state.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1062025-01-17T08:20:09.708ZINFOSledAgent (bootstore): No ledger found. Loading Fsm::State as Uninitialized file = bootstore/src/schemes/v0/storage.rs:83 peer_id = pc-sock-i86pc
1072025-01-17T08:20:09.708ZINFOSledAgent (bootstore): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1082025-01-17T08:20:09.708ZINFOSledAgent (bootstore): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/cluster/bootstore-network-config.json file = common/src/ledger.rs:188 peer_id = pc-sock-i86pc
1092025-01-17T08:20:09.708ZINFOSledAgent (bootstore): No ledger found for network config file = bootstore/src/schemes/v0/storage.rs:146 peer_id = pc-sock-i86pc
1102025-01-17T08:20:09.708ZINFOSledAgent: Starting Bootstore DDMD poller file = sled-agent/src/long_running_tasks.rs:216
1112025-01-17T08:20:09.708ZINFOSledAgent: Starting ZoneBundler related tasks file = sled-agent/src/long_running_tasks.rs:231
1122025-01-17T08:20:09.718ZINFOSledAgent (ServiceManager): Creating ServiceManager file = sled-agent/src/services.rs:737
1132025-01-17T08:20:09.718ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 1718, tv_nsec: 511721221 } time_to_next_cleanup = 599.99992227s
1142025-01-17T08:20:09.718ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
1152025-01-17T08:20:09.718ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1162025-01-17T08:20:09.718ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/sled-agent-request.json file = common/src/ledger.rs:188
1172025-01-17T08:20:09.718ZINFOSledAgent (BootstrapAgentStartup): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/sled-agent-request.json file = common/src/ledger.rs:188
1182025-01-17T08:20:09.721ZINFOSledAgent (dropshot (BootstrapAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fdb0:18c0:4d0d:a02a::1]:80
1192025-01-17T08:20:09.723ZINFOSledAgent (SledAgentSprocketsServer): Started listening file = sled-agent/src/bootstrap/sprockets_server.rs:51 local_addr = [fdb0:18c0:4d0d:a02a::1]:12346
1202025-01-17T08:20:09.724ZINFOSledAgent (RSS): Injecting RSS configuration: RackInitializeRequest { trust_quorum_peers: None, bootstrap_discovery: OnlyOurs, ntp_servers: [ "0.pool.ntp.org", ], dns_servers: [ 1.1.1.1, 9.9.9.9, ], internal_services_ip_pool_ranges: [ V4( Ipv4Range { first: 10.151.2.164, last: 10.151.2.173, }, ), ], external_dns_ips: [ 10.151.2.164, 10.151.2.165, ], external_dns_zone_name: "oxide.test", external_certificates: "<redacted>", recovery_silo: RecoverySiloConfig { silo_name: Name( "recovery", ), user_name: UserId( "recovery", ), user_password_hash: NewPasswordHash( PasswordHashString { string: "$argon2id$v=19$m=98304,t=13,p=1$RUlWc0ZxaHo0WFdrN0N6ZQ$S8p52j85GPvMhR/ek3GL0el/oProgTwWpHJZ8lsQQoY", encoding: B64, }, ), }, rack_network_config: RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None, }, ], addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some( None, ), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None, }, ], bgp: [], bfd: [], }, allowed_source_ips: Any, } file = sled-agent/src/rack_setup/service.rs:1204
1212025-01-17T08:20:09.724ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1222025-01-17T08:20:09.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1232025-01-17T08:20:09.724ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1242025-01-17T08:20:09.724ZINFOSledAgent (RSS): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/rss-started.marker file = common/src/ledger.rs:188
1252025-01-17T08:20:09.724ZINFOSledAgent (RSS): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/rss-started.marker file = common/src/ledger.rs:188
1262025-01-17T08:20:09.724ZINFOSledAgent (RSS): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1272025-01-17T08:20:09.724ZINFOSledAgent (RSS): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/rss-plan-completed.marker file = common/src/ledger.rs:188
1282025-01-17T08:20:09.724ZINFOSledAgent (RSS): RSS not previously run. Creating plans. file = sled-agent/src/rack_setup/service.rs:1253
1292025-01-17T08:20:09.724ZINFOSledAgent (RSS): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1302025-01-17T08:20:09.724ZINFOSledAgent (RSS): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/.rss-started.marker.tmp file = common/src/ledger.rs:199
1312025-01-17T08:20:09.724ZINFOSledAgent (RSS): Creating new allocation plan file = sled-agent/src/rack_setup/service.rs:1285
1322025-01-17T08:20:09.724ZINFOSledAgent (RSS): Serializing plan file = sled-agent/src/rack_setup/plan/sled.rs:66
1332025-01-17T08:20:09.724ZINFOSledAgent (RSS): Creating plan for the sled at fdb0:18c0:4d0d:a02a::1 file = sled-agent/src/rack_setup/plan/sled.rs:39
1342025-01-17T08:20:09.724ZINFOSledAgent (RSS): Writing Rack Network Configuration to bootstore file = sled-agent/src/rack_setup/service.rs:1316
1352025-01-17T08:20:09.724ZINFOSledAgent (bootstore): Attempting to update network config with generation: 1, current_generation: 0 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
1362025-01-17T08:20:09.724ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1372025-01-17T08:20:09.725ZINFOSledAgent (bootstore): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
1382025-01-17T08:20:09.725ZINFOSledAgent (bootstore): Broadcasting network config with generation 1 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
1392025-01-17T08:20:09.725ZINFOSledAgent (BootstrapAgentRssHandler): Received initialization request from RSS file = sled-agent/src/bootstrap/rss_handle.rs:232 request = StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: fbac3378-7daf-4aef-b0f5-d2cd5264f30e (sled), rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
1402025-01-17T08:20:09.725ZINFOSledAgent (ServiceManager): Enabling switch zone (new) file = sled-agent/src/services.rs:4253
1412025-01-17T08:20:09.725ZINFOSledAgent (ServiceManager): Starting switch zone file = sled-agent/src/services.rs:4653
1422025-01-17T08:20:09.730ZINFOSledAgent (SledAgentSprocketsClient): Loaded keys and certs BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/client.rs:50
1432025-01-17T08:20:09.736ZINFOSledAgent (SledAgentSprocketsClient): Certificate chain verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1442025-01-17T08:20:09.736ZINFOSledAgent (SledAgentSprocketsClient): Signature verified successfully BootstrapAgentClient = [fdb0:18c0:4d0d:a02a::1]:12346 file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1452025-01-17T08:20:09.740ZINFOSledAgent (SledAgentSprocketsServer): Certificate chain verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:307
1462025-01-17T08:20:09.740ZINFOSledAgent (SledAgentSprocketsServer): Signature verified successfully file = /home/build/.cargo/git/checkouts/sprockets-82488b5b61bf00db/cc13773/tls/src/keys.rs:376
1472025-01-17T08:20:09.740ZINFOSledAgent (SledAgentSprocketsServer): Accepted connection file = sled-agent/src/bootstrap/sprockets_server.rs:74 remote_addr = [fdb0:18c0:4d0d:a02a::1]:64264
1482025-01-17T08:20:09.741ZINFOSledAgent (SledAgentMain): Loading Sled Agent: StartSledAgentRequest { generation: 0, schema_version: 1, body: StartSledAgentRequestBody { id: fbac3378-7daf-4aef-b0f5-d2cd5264f30e (sled), rack_id: d35a4c82-5298-4dae-8513-0a85ba980a8f, use_trust_quorum: false, is_lrtq_learner: false, subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344:101::, width: 64 } } } } file = sled-agent/src/bootstrap/server.rs:362
1492025-01-17T08:20:09.741ZINFOSledAgent (SledAgentMain): KeyManager: using hardcoded secret retriever file = sled-agent/src/bootstrap/server.rs:377
1502025-01-17T08:20:09.741ZINFOSledAgent: setting up sled agent server file = sled-agent/src/server.rs:44
1512025-01-17T08:20:09.741ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
1522025-01-17T08:20:09.741ZINFOSledAgent (StorageManager): Received KeyManagerReady file = sled-storage/src/manager.rs:607
1532025-01-17T08:20:09.741ZINFOSledAgent (StorageManager): Loading storage config file = sled-storage/src/manager.rs:813
1542025-01-17T08:20:09.741ZINFOSledAgent (StorageManager): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1552025-01-17T08:20:09.741ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:101::, width: 64 }
1562025-01-17T08:20:09.741ZINFOSledAgent (StorageManager): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = load_disks_ledger
1572025-01-17T08:20:09.741ZINFOSledAgent (StorageManager): No ledger of physical disks exists file = sled-storage/src/manager.rs:802
1582025-01-17T08:20:09.741ZINFOSledAgent (StorageManager): KeyManager ready, but no ledger detected file = sled-storage/src/manager.rs:830
1592025-01-17T08:20:09.741ZINFOSledAgent (StorageManager): automatically managing disks file = sled-storage/src/manager.rs:596
1602025-01-17T08:20:09.741ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
1612025-01-17T08:20:09.741ZINFOSledAgent (StorageManager): Successfully synchronized disks without error file = sled-storage/src/manager.rs:701 result = DisksManagementResult { status: [] }
1622025-01-17T08:20:09.756ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1632025-01-17T08:20:09.777ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:325
1642025-01-17T08:20:09.794ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_switch file = illumos-utils/src/zone.rs:363
1652025-01-17T08:20:09.805ZINFOSledAgent: SledAgent::new(..) starting file = sled-agent/src/sled_agent.rs:422 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1662025-01-17T08:20:09.805ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
1672025-01-17T08:20:09.805ZINFOSledAgent: Requested swap device of size 64 GiB file = sled-agent/src/sled_agent.rs:434 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1682025-01-17T08:20:09.805ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1692025-01-17T08:20:09.808ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 103.199778ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6c59dbfd-3915-424a-b2de-ea0fc606817d", "content-length": "124", "date": "Fri, 17 Jan 2025 08:20:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6c59dbfd-3915-424a-b2de-ea0fc606817d" } file = clients/ddm-admin-client/src/lib.rs:177
1702025-01-17T08:20:09.820ZINFOSledAgent: attempting to create encrypted zvol: name="oxi_a43cfd5f-429f-4cbf-a67a-3a5aec478829/swap", size_gb=64 file = sled-agent/src/swap_device.rs:153
1712025-01-17T08:20:09.844ZINFOSledAgent: successfully created encrypted zvol: name="oxi_a43cfd5f-429f-4cbf-a67a-3a5aec478829/swap", size_gb=64 file = sled-agent/src/swap_device.rs:249
1722025-01-17T08:20:09.844ZINFOSledAgent: adding swap device: swapname="/dev/zvol/dsk/oxi_a43cfd5f-429f-4cbf-a67a-3a5aec478829/swap" file = sled-agent/src/swap_device.rs:96
1732025-01-17T08:20:09.849ZINFOSledAgent: Mounting backing filesystems file = sled-agent/src/sled_agent.rs:449 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1742025-01-17T08:20:09.849ZINFOSledAgent (BackingFs): Processing fmd file = sled-agent/src/backing_fs.rs:129
1752025-01-17T08:20:09.849ZINFOSledAgent (BackingFs): Ensuring dataset oxi_a43cfd5f-429f-4cbf-a67a-3a5aec478829/backing/fmd file = sled-agent/src/backing_fs.rs:139
1762025-01-17T08:20:09.912ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1772025-01-17T08:20:09.913ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 82.488127ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "f3bf8135-5015-4e3b-a07d-b1d491ff323c", "content-length": "124", "date": "Fri, 17 Jan 2025 08:20:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "f3bf8135-5015-4e3b-a07d-b1d491ff323c" } file = clients/ddm-admin-client/src/lib.rs:177
1782025-01-17T08:20:09.922ZINFOSledAgent (BackingFs): Stopping service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:174
1792025-01-17T08:20:09.996ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1802025-01-17T08:20:09.997ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 209.105811ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c0529d68-7e2c-4c0b-a357-0c42cb39dd22", "content-length": "124", "date": "Fri, 17 Jan 2025 08:20:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c0529d68-7e2c-4c0b-a357-0c42cb39dd22" } file = clients/ddm-admin-client/src/lib.rs:177
1812025-01-17T08:20:10.141ZINFOSledAgent (BackingFs): Mounting oxi_a43cfd5f-429f-4cbf-a67a-3a5aec478829/backing/fmd on /var/fm/fmd file = sled-agent/src/backing_fs.rs:182
1822025-01-17T08:20:10.154ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/rsrc file = sled-agent/src/backing_fs.rs:190
1832025-01-17T08:20:10.154ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/ckpt file = sled-agent/src/backing_fs.rs:190
1842025-01-17T08:20:10.154ZINFOSledAgent (BackingFs): Ensuring directory /var/fm/fmd/xprt file = sled-agent/src/backing_fs.rs:190
1852025-01-17T08:20:10.154ZINFOSledAgent (BackingFs): Starting service svc:/system/fmd:default file = sled-agent/src/backing_fs.rs:196
1862025-01-17T08:20:10.207ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1872025-01-17T08:20:10.208ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 217.918768ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "df3c4617-dce9-4ad0-a6b8-36779ef2969a", "content-length": "124", "date": "Fri, 17 Jan 2025 08:20:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "df3c4617-dce9-4ad0-a6b8-36779ef2969a" } file = clients/ddm-admin-client/src/lib.rs:177
1882025-01-17T08:20:10.428ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1892025-01-17T08:20:10.428ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 174.068502ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "6e24ee41-e57e-4b92-a153-5faa1eb27d8b", "content-length": "124", "date": "Fri, 17 Jan 2025 08:20:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "6e24ee41-e57e-4b92-a153-5faa1eb27d8b" } file = clients/ddm-admin-client/src/lib.rs:177
1902025-01-17T08:20:10.604ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
1912025-01-17T08:20:10.604ZINFOSledAgent (BootstrapAgentStartup): Failed enable ddm stats (will retry after 350.023203ms) DdmAdminClient = [::1]:8000 err = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "cdcda1c4-927a-4307-b382-5964ecc05796", "content-length": "124", "date": "Fri, 17 Jan 2025 08:20:09 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "cdcda1c4-927a-4307-b382-5964ecc05796" } file = clients/ddm-admin-client/src/lib.rs:177
1922025-01-17T08:20:10.889ZINFOSledAgent: using '[AddrObject { interface: "net0", name: "ll" }, AddrObject { interface: "net1", name: "ll" }]' as data links for xde driver file = illumos-utils/src/opte/illumos.rs:93 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1932025-01-17T08:20:10.894ZINFOSledAgent (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:48872 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1942025-01-17T08:20:10.894ZINFOSledAgent (internal-dns-resolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1952025-01-17T08:20:10.894ZINFOSledAgent (producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::1]:48872 file = oximeter/producer/src/lib.rs:279 interval = 30s producer_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1962025-01-17T08:20:10.895ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 193.082654ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1972025-01-17T08:20:10.896ZINFOSledAgent (VmmReservoirManager): 50% of 102952026112 physical ram = 51476013056 bytes) file = sled-agent/src/vmm_reservoir.rs:267 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1982025-01-17T08:20:10.896ZINFOSledAgent (VmmReservoirManager): Setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:275 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
1992025-01-17T08:20:10.896ZINFOSledAgent (ServiceManager): sled agent started file = sled-agent/src/services.rs:921 underlay_address = fd00:1122:3344:101::1
2002025-01-17T08:20:10.896ZINFOSledAgent (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
2012025-01-17T08:20:10.956ZINFOSledAgent (BootstrapAgentStartup): Enabling ddm stats DdmAdminClient = [::1]:8000 addr = fd00:1122:3344:101::1 dns_servers = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = clients/ddm-admin-client/src/lib.rs:163
2022025-01-17T08:20:11.091ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 252.438873ms error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2032025-01-17T08:20:11.345ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 1.18044687s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2042025-01-17T08:20:12.526ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 2.082300611s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2052025-01-17T08:20:13.514ZINFOSledAgent (ServiceManager): Setting up dendrite service file = sled-agent/src/services.rs:2677
2062025-01-17T08:20:13.514ZINFOSledAgent (ServiceManager): Setting up lldpd service file = sled-agent/src/services.rs:2922
2072025-01-17T08:20:13.514ZINFOSledAgent (ServiceManager): Setting up MGS service file = sled-agent/src/services.rs:2547
2082025-01-17T08:20:13.514ZINFOSledAgent (ServiceManager): Setting up wicketd service file = sled-agent/src/services.rs:2594
2092025-01-17T08:20:13.514ZINFOSledAgent (ServiceManager): Setting up mgd service file = sled-agent/src/services.rs:3003
2102025-01-17T08:20:13.514ZINFOSledAgent (ServiceManager): Setting up mg-ddm service file = sled-agent/src/services.rs:3048
2112025-01-17T08:20:13.516ZINFOSledAgent (ServiceManager): Setting up tfport service file = sled-agent/src/services.rs:2847
2122025-01-17T08:20:13.518ZINFOSledAgent (ServiceManager): Setting up Simulated SP service file = sled-agent/src/services.rs:2588
2132025-01-17T08:20:13.518ZINFOSledAgent (ServiceManager): Profile for oxz_switch: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/mgs"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12225'/> <propval type="astring" name="id" value='d7a2f2dc-b57b-446b-b5b3-0c4709956a73'/> <propval type="astring" name="rack_id" value='d35a4c82-5298-4dae-8513-0a85ba980a8f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/wicketd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="address" value='[::1]:12226'/> <propval type="astring" name="artifact-address" value='[fdb0:18c0:4d0d:a02a::2]:12227'/> <propval type="astring" name="baseboard-file" value='/opt/oxide/baseboard.json'/> <propval type="astring" name="mgs-address" value='[::1]:12225'/> <propval type="astring" name="nexus-proxy-address" value='[::]:12229'/> <propval type="astring" name="rack-subnet" value='fd00:1122:3344::'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/switch_zone_setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="gz_local_link_addr" value='fe80::8:20ff:fe04:d6aa'/> <property type="astring" name="link_local_links"> <astring_list> <value_node value="tfportrear0_0" /> <value_node value="oxBootstrap0" /> </astring_list> </property> <propval type="astring" name="bootstrap_addr" value='fdb0:18c0:4d0d:a02a::2'/> <propval type="astring" name="bootstrap_vnic" value='oxBootstrap0'/> <propval type="astring" name="baseboard_info" value='{"type":"pc","identifier":"sock","model":"i86pc"}'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/dendrite"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="rack_id" value='d35a4c82-5298-4dae-8513-0a85ba980a8f'/> <propval type="astring" name="sled_id" value='fbac3378-7daf-4aef-b0f5-d2cd5264f30e'/> <propval type="astring" name="sled_model" value='i86pc'/> <propval type="astring" name="sled_serial" value='sock'/> <propval type="astring" name="sled_revision" value='0'/> <propval type="astring" name="address" value='[::1]:12224'/> <propval type="astring" name="front_ports" value='1'/> <propval type="astring" name="rear_ports" value='1'/> <propval type="astring" name="port_config" value='/opt/oxide/dendrite/misc/softnpu_single_sled_config.toml'/> <propval type="astring" name="mgmt" value='uds'/> <propval type="astring" name="uds_path" value='/opt/softnpu/stuff'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/tfport"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="host" value='[::1]'/> <propval type="astring" name="port" value='12224'/> <propval type="astring" name="flags" value='--sync-only'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/lldpd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="board_rev" value='softnpu_front_1_rear_1'/> <propval type="astring" name="scrimlet_id" value='sock'/> <propval type="astring" name="scrimlet_model" value='i86pc'/> <propval type="astring" name="address" value='[::1]:12230'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/pumpkind"> </service> <service version="1" type="service" name="oxide/mgd"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="sled_uuid" value='fbac3378-7daf-4aef-b0f5-d2cd5264f30e'/> <propval type="astring" name="rack_uuid" value='d35a4c82-5298-4dae-8513-0a85ba980a8f'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/mg-ddm"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="mode" value='transit'/> <propval type="astring" name="dendrite" value='true'/> <propval type="astring" name="sled_uuid" value='fbac3378-7daf-4aef-b0f5-d2cd5264f30e'/> <propval type="astring" name="rack_uuid" value='d35a4c82-5298-4dae-8513-0a85ba980a8f'/> <propval type="astring" name="interfaces" value='tfportrear0_0/ll'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/uplink"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
2142025-01-17T08:20:13.518ZINFOSledAgent (ServiceManager): Booting oxz_switch zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_switch
2152025-01-17T08:20:13.832ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 49.488333ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2162025-01-17T08:20:14.034ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 101.15007ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2172025-01-17T08:20:14.236ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 282.507423ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2182025-01-17T08:20:14.608ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 567.624219ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2192025-01-17T08:20:14.610ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 5.327988836s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2202025-01-17T08:20:15.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.157996767s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2212025-01-17T08:20:16.488ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 908.137933ms file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2222025-01-17T08:20:17.551ZWARNSledAgent (ServiceManager): wait for service Some("oxz_switch") failed: Property not found. retry in 1.43978731s file = illumos-utils/src/svc.rs:42 zone = oxz_switch
2232025-01-17T08:20:19.366ZWARNSledAgent (NexusNotifierTask): Received Error from Nexus for Get request: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/sled-agents/fbac3378-7daf-4aef-b0f5-d2cd5264f30e) file = sled-agent/src/nexus.rs:527 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2242025-01-17T08:20:19.395ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2252025-01-17T08:20:19.396ZINFOSledAgent (dropshot (Repo Depot)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12348 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2262025-01-17T08:20:19.397ZINFOSledAgent (dropshot (SledAgent)): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:328 local_addr = [fd00:1122:3344:101::1]:12345
2272025-01-17T08:20:19.397ZINFOSledAgent (SledAgentMain): Sled Agent loaded; recording configuration file = sled-agent/src/bootstrap/server.rs:432
2282025-01-17T08:20:19.397ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2292025-01-17T08:20:19.397ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2302025-01-17T08:20:19.397ZINFOSledAgent (SledAgentMain): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/.sled-agent-request.json.tmp file = common/src/ledger.rs:199
2312025-01-17T08:20:19.398ZINFOSledAgent (HardwareMonitor): Sled Agent Started file = sled-agent/src/hardware_monitor.rs:138
2322025-01-17T08:20:19.398ZINFOSledAgent (HardwareMonitor): Checking current full hardware snapshot disks = {} file = sled-agent/src/hardware_monitor.rs:271 underlay_network_info = Some((fd00:1122:3344:101::2, Some(RackNetworkConfigV2 { rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 }, infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [PortConfigV2 { routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.2.100, vlan_id: None, rib_priority: None }], addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], switch: Switch0, port: "qsfp0", uplink_port_speed: Speed40G, uplink_port_fec: Some(None), bgp_peers: [], autoneg: false, lldp: None, tx_eq: None }], bgp: [], bfd: [] })))
2332025-01-17T08:20:19.398ZINFOSledAgent (ServiceManager): Ensuring scrimlet services (enabling services) file = sled-agent/src/services.rs:3956
2342025-01-17T08:20:19.398ZINFOSledAgent (SledAgentSprocketsServer): Connection closed file = sled-agent/src/bootstrap/sprockets_server.rs:81 remote_addr = [fdb0:18c0:4d0d:a02a::1]:64264
2352025-01-17T08:20:19.587ZINFOSledAgent (BootstrapAgentRssHandler): Peer agent initialized file = sled-agent/src/bootstrap/rss_handle.rs:117 peer = [fdb0:18c0:4d0d:a02a::1]:12346
2362025-01-17T08:20:19.587ZINFOSledAgent (BootstrapAgentRssHandler): Initialized sled agent file = sled-agent/src/bootstrap/rss_handle.rs:252 target_sled = [fdb0:18c0:4d0d:a02a::1]:12346
2372025-01-17T08:20:19.593ZINFOSledAgent (ServiceManager): Re-enabling running switch zone (new address) file = sled-agent/src/services.rs:4277 new = [fd00:1122:3344:101::2, ::1] old = [::1]
2382025-01-17T08:20:19.593ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists file = sled-agent/src/services.rs:4293
2392025-01-17T08:20:19.593ZINFOSledAgent (ServiceManager): Adding address: Static(V6(Ipv6Network { addr: fd00:1122:3344:101::2, prefix: 64 })) file = illumos-utils/src/running_zone.rs:534 zone = oxz_switch
2402025-01-17T08:20:19.826ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41561
2412025-01-17T08:20:19.827ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2422025-01-17T08:20:19.827ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
2432025-01-17T08:20:19.827ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:188
2442025-01-17T08:20:19.827ZINFOSledAgent (ServiceManager): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:188
2452025-01-17T08:20:19.827ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41561 req_id = db7f3c7e-e593-4c8f-a044-9473b96f34d4 response_code = 200 uri = /inventory
2462025-01-17T08:20:19.857ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44953
2472025-01-17T08:20:19.857ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:44953 req_id = fe19e366-fba7-44bb-81f6-10e8a3649d82 response_code = 200 uri = /sled-role
2482025-01-17T08:20:19.887ZINFOSledAgent (RSS): attempting to set up sled's storage: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 2fe9fb62-686f-4786-8f6c-ac0b8e481d73 (physical_disk), pool_id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 31e235e0-984c-4f9b-8936-51b018d0e791 (physical_disk), pool_id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 3884b35a-7a1f-4532-852b-dcb5c3757391 (physical_disk), pool_id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 75344f95-2b57-4c8e-adb6-434a4f2d88c3 (physical_disk), pool_id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 79120d0a-d921-4681-be1a-ba5b08e6eaf7 (physical_disk), pool_id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 8b42b813-0eb0-4d56-ac06-d6112aa9f143 (physical_disk), pool_id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9cb4e9b2-01b9-4f4f-be6e-224dac6db822 (physical_disk), pool_id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: c1dabca1-cdac-4ec8-9ab1-a23ab93a5af1 (physical_disk), pool_id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: d1ef6f00-aba0-4b3f-a781-17bb46a0e015 (physical_disk), pool_id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool) }] } file = sled-agent/src/rack_setup/service.rs:385 sled_address = [fd00:1122:3344:101::1]:12345
2492025-01-17T08:20:19.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57672
2502025-01-17T08:20:19.887ZINFOSledAgent: physical disks ensure file = sled-agent/src/sled_agent.rs:903 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2512025-01-17T08:20:19.887ZINFOSledAgent (StorageManager): Received OmicronPhysicalDisksEnsure { config: OmicronPhysicalDisksConfig { generation: Generation(2), disks: [OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, id: 2fe9fb62-686f-4786-8f6c-ac0b8e481d73 (physical_disk), pool_id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, id: 31e235e0-984c-4f9b-8936-51b018d0e791 (physical_disk), pool_id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, id: 3884b35a-7a1f-4532-852b-dcb5c3757391 (physical_disk), pool_id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, id: 75344f95-2b57-4c8e-adb6-434a4f2d88c3 (physical_disk), pool_id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, id: 79120d0a-d921-4681-be1a-ba5b08e6eaf7 (physical_disk), pool_id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, id: 8b42b813-0eb0-4d56-ac06-d6112aa9f143 (physical_disk), pool_id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, id: 9cb4e9b2-01b9-4f4f-be6e-224dac6db822 (physical_disk), pool_id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, id: c1dabca1-cdac-4ec8-9ab1-a23ab93a5af1 (physical_disk), pool_id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool) }, OmicronPhysicalDiskConfig { identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, id: d1ef6f00-aba0-4b3f-a781-17bb46a0e015 (physical_disk), pool_id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool) }] }, tx: ... } file = sled-storage/src/manager.rs:607
2522025-01-17T08:20:19.887ZINFOSledAgent (StorageManager): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2532025-01-17T08:20:19.887ZINFOSledAgent (StorageManager): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-physical-disks.json file = common/src/ledger.rs:188 request = omicron_physical_disks_ensure
2542025-01-17T08:20:19.887ZINFOSledAgent (StorageManager): No previously-stored 'requested disks', creating new ledger file = sled-storage/src/manager.rs:1298 request = omicron_physical_disks_ensure
2552025-01-17T08:20:19.887ZINFOSledAgent (StorageResources): Synchronizing disk managment file = sled-storage/src/resources.rs:302
2562025-01-17T08:20:19.887ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:342
2572025-01-17T08:20:19.887ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2582025-01-17T08:20:19.887ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } path = /scratch/u2_0.vdev
2592025-01-17T08:20:20.040ZWARNSledAgent (producer-registration-task): failed to lookup Nexus IP, will retry delay = 9.239229787s error = "proto error: io error: No route to host (os error 148)" file = oximeter/producer/src/lib.rs:387 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2602025-01-17T08:20:20.046ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_0.vdev file = sled-hardware/src/disk.rs:367
2612025-01-17T08:20:20.046ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool)
2622025-01-17T08:20:20.484ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e) file = sled-agent/src/probe_manager.rs:231 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2632025-01-17T08:20:20.920ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2642025-01-17T08:20:20.920ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2652025-01-17T08:20:21.112ZINFOSledAgent (VmmReservoirManager): Finished setting reservoir size to 49090 MiB bytes file = sled-agent/src/vmm_reservoir.rs:279 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2662025-01-17T08:20:21.124ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }
2672025-01-17T08:20:21.132ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/dataset.rs:239
2682025-01-17T08:20:21.132ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:241
2692025-01-17T08:20:21.132ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:245
2702025-01-17T08:20:21.132ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } epoch = 0 file = sled-storage/src/dataset.rs:247
2712025-01-17T08:20:21.132ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2722025-01-17T08:20:21.132ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key")
2732025-01-17T08:20:21.132ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2742025-01-17T08:20:21.166ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-0-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2752025-01-17T08:20:21.175ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/zone file = sled-storage/src/dataset.rs:302
2762025-01-17T08:20:21.314ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_028b6e25-416e-42c3-8d32-3331a24bdea1 file = sled-storage/src/dataset.rs:388
2772025-01-17T08:20:21.322ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:440
2782025-01-17T08:20:21.322ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" } file = sled-storage/src/resources.rs:357
2792025-01-17T08:20:21.322ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:342
2802025-01-17T08:20:21.322ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
2812025-01-17T08:20:21.322ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } path = /scratch/u2_1.vdev
2822025-01-17T08:20:21.332ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_1.vdev file = sled-hardware/src/disk.rs:367
2832025-01-17T08:20:21.332ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool)
2842025-01-17T08:20:21.421ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }
2852025-01-17T08:20:21.429ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/dataset.rs:239
2862025-01-17T08:20:21.429ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:241
2872025-01-17T08:20:21.429ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:245
2882025-01-17T08:20:21.429ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } epoch = 0 file = sled-storage/src/dataset.rs:247
2892025-01-17T08:20:21.429ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2902025-01-17T08:20:21.429ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key")
2912025-01-17T08:20:21.429ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
2922025-01-17T08:20:21.462ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-1-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
2932025-01-17T08:20:21.470ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone file = sled-storage/src/dataset.rs:302
2942025-01-17T08:20:21.487ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e) file = sled-agent/src/probe_manager.rs:231 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
2952025-01-17T08:20:21.609ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739 file = sled-storage/src/dataset.rs:388
2962025-01-17T08:20:21.617ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:440
2972025-01-17T08:20:21.617ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" } file = sled-storage/src/resources.rs:357
2982025-01-17T08:20:21.617ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:342
2992025-01-17T08:20:21.617ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3002025-01-17T08:20:21.617ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } path = /scratch/u2_2.vdev
3012025-01-17T08:20:21.627ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_2.vdev file = sled-hardware/src/disk.rs:367
3022025-01-17T08:20:21.627ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool)
3032025-01-17T08:20:21.720ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }
3042025-01-17T08:20:21.728ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/dataset.rs:239
3052025-01-17T08:20:21.728ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:241
3062025-01-17T08:20:21.728ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:245
3072025-01-17T08:20:21.728ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } epoch = 0 file = sled-storage/src/dataset.rs:247
3082025-01-17T08:20:21.728ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3092025-01-17T08:20:21.728ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key")
3102025-01-17T08:20:21.728ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3112025-01-17T08:20:21.761ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-2-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3122025-01-17T08:20:21.768ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/zone file = sled-storage/src/dataset.rs:302
3132025-01-17T08:20:21.904ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_0ab7c39f-5947-4112-8347-2ecc105352ff file = sled-storage/src/dataset.rs:388
3142025-01-17T08:20:21.912ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:440
3152025-01-17T08:20:21.912ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" } file = sled-storage/src/resources.rs:357
3162025-01-17T08:20:21.912ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:342
3172025-01-17T08:20:21.912ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3182025-01-17T08:20:21.912ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } path = /scratch/u2_3.vdev
3192025-01-17T08:20:21.922ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_3.vdev file = sled-hardware/src/disk.rs:367
3202025-01-17T08:20:21.922ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool)
3212025-01-17T08:20:22.019ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }
3222025-01-17T08:20:22.029ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/dataset.rs:239
3232025-01-17T08:20:22.029ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:241
3242025-01-17T08:20:22.029ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:245
3252025-01-17T08:20:22.029ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } epoch = 0 file = sled-storage/src/dataset.rs:247
3262025-01-17T08:20:22.029ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3272025-01-17T08:20:22.029ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key")
3282025-01-17T08:20:22.029ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3292025-01-17T08:20:22.066ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-3-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3302025-01-17T08:20:22.074ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone file = sled-storage/src/dataset.rs:302
3312025-01-17T08:20:22.214ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f file = sled-storage/src/dataset.rs:388
3322025-01-17T08:20:22.222ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:440
3332025-01-17T08:20:22.222ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" } file = sled-storage/src/resources.rs:357
3342025-01-17T08:20:22.222ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:342
3352025-01-17T08:20:22.222ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3362025-01-17T08:20:22.222ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } path = /scratch/u2_4.vdev
3372025-01-17T08:20:22.231ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_4.vdev file = sled-hardware/src/disk.rs:367
3382025-01-17T08:20:22.231ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool)
3392025-01-17T08:20:22.326ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }
3402025-01-17T08:20:22.334ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/dataset.rs:239
3412025-01-17T08:20:22.334ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:241
3422025-01-17T08:20:22.334ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:245
3432025-01-17T08:20:22.334ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } epoch = 0 file = sled-storage/src/dataset.rs:247
3442025-01-17T08:20:22.334ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3452025-01-17T08:20:22.334ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key")
3462025-01-17T08:20:22.335ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3472025-01-17T08:20:22.371ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-4-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3482025-01-17T08:20:22.378ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone file = sled-storage/src/dataset.rs:302
3492025-01-17T08:20:22.491ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e) file = sled-agent/src/probe_manager.rs:231 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
3502025-01-17T08:20:22.513ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b file = sled-storage/src/dataset.rs:388
3512025-01-17T08:20:22.520ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:440
3522025-01-17T08:20:22.520ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" } file = sled-storage/src/resources.rs:357
3532025-01-17T08:20:22.520ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:342
3542025-01-17T08:20:22.520ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3552025-01-17T08:20:22.521ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } path = /scratch/u2_5.vdev
3562025-01-17T08:20:22.531ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_5.vdev file = sled-hardware/src/disk.rs:367
3572025-01-17T08:20:22.531ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool)
3582025-01-17T08:20:22.629ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }
3592025-01-17T08:20:22.637ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/dataset.rs:239
3602025-01-17T08:20:22.637ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:241
3612025-01-17T08:20:22.637ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:245
3622025-01-17T08:20:22.637ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } epoch = 0 file = sled-storage/src/dataset.rs:247
3632025-01-17T08:20:22.637ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3642025-01-17T08:20:22.637ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key")
3652025-01-17T08:20:22.637ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3662025-01-17T08:20:22.673ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-5-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3672025-01-17T08:20:22.681ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_77842ceb-2fab-4804-a283-1a7c8f995913/crypt/zone file = sled-storage/src/dataset.rs:302
3682025-01-17T08:20:22.819ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_77842ceb-2fab-4804-a283-1a7c8f995913 file = sled-storage/src/dataset.rs:388
3692025-01-17T08:20:22.826ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:440
3702025-01-17T08:20:22.826ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" } file = sled-storage/src/resources.rs:357
3712025-01-17T08:20:22.826ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:342
3722025-01-17T08:20:22.826ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3732025-01-17T08:20:22.826ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } path = /scratch/u2_6.vdev
3742025-01-17T08:20:22.837ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_6.vdev file = sled-hardware/src/disk.rs:367
3752025-01-17T08:20:22.837ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool)
3762025-01-17T08:20:22.931ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }
3772025-01-17T08:20:22.940ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/dataset.rs:239
3782025-01-17T08:20:22.940ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:241
3792025-01-17T08:20:22.940ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:245
3802025-01-17T08:20:22.940ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } epoch = 0 file = sled-storage/src/dataset.rs:247
3812025-01-17T08:20:22.940ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3822025-01-17T08:20:22.940ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key")
3832025-01-17T08:20:22.940ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
3842025-01-17T08:20:22.975ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-6-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
3852025-01-17T08:20:22.982ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/zone file = sled-storage/src/dataset.rs:302
3862025-01-17T08:20:23.118ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab file = sled-storage/src/dataset.rs:388
3872025-01-17T08:20:23.126ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:440
3882025-01-17T08:20:23.126ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" } file = sled-storage/src/resources.rs:357
3892025-01-17T08:20:23.126ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:342
3902025-01-17T08:20:23.126ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
3912025-01-17T08:20:23.126ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } path = /scratch/u2_7.vdev
3922025-01-17T08:20:23.135ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_7.vdev file = sled-hardware/src/disk.rs:367
3932025-01-17T08:20:23.135ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool)
3942025-01-17T08:20:23.233ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }
3952025-01-17T08:20:23.240ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/dataset.rs:239
3962025-01-17T08:20:23.240ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:241
3972025-01-17T08:20:23.240ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:245
3982025-01-17T08:20:23.240ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } epoch = 0 file = sled-storage/src/dataset.rs:247
3992025-01-17T08:20:23.240ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4002025-01-17T08:20:23.241ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key")
4012025-01-17T08:20:23.241ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4022025-01-17T08:20:23.275ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-7-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4032025-01-17T08:20:23.282ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crypt/zone file = sled-storage/src/dataset.rs:302
4042025-01-17T08:20:23.424ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded file = sled-storage/src/dataset.rs:388
4052025-01-17T08:20:23.432ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:440
4062025-01-17T08:20:23.432ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" } file = sled-storage/src/resources.rs:357
4072025-01-17T08:20:23.432ZINFOSledAgent (StorageResources): Managing disk disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:342
4082025-01-17T08:20:23.432ZINFOSledAgent (StorageResources): Invoking Disk::new on an unmanaged disk file = sled-storage/src/resources.rs:419
4092025-01-17T08:20:23.432ZINFOSledAgent (StorageResources): Invoking SyntheticDisk::new file = sled-storage/src/disk.rs:65 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } path = /scratch/u2_8.vdev
4102025-01-17T08:20:23.442ZINFOSledAgent (StorageResources): GPT exists without Zpool: formatting zpool at /scratch/u2_8.vdev file = sled-hardware/src/disk.rs:367
4112025-01-17T08:20:23.442ZINFOSledAgent (StorageResources): Formatting zpool with requested ID file = sled-hardware/src/disk.rs:373 id = 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool)
4122025-01-17T08:20:23.539ZINFOSledAgent (StorageResources): Ensuring zpool has datasets disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:196 zpool = ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }
4132025-01-17T08:20:23.547ZINFOSledAgent (StorageResources): Loading latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/dataset.rs:239
4142025-01-17T08:20:23.548ZINFOSledAgent (StorageResources): Loaded latest secret disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:241
4152025-01-17T08:20:23.548ZINFOSledAgent (StorageResources): Retrieving key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:245
4162025-01-17T08:20:23.548ZINFOSledAgent (StorageResources): Got key disk_id = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } epoch = 0 file = sled-storage/src/dataset.rs:247
4172025-01-17T08:20:23.548ZINFOSledAgent (StorageResources): About to create keyfile file = sled-storage/src/keyfile.rs:30 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4182025-01-17T08:20:23.548ZINFOSledAgent (StorageResources): Created keyfile file = sled-storage/src/keyfile.rs:34 path = Keypath("/var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key")
4192025-01-17T08:20:23.548ZINFOSledAgent (StorageResources): Ensuring encrypted filesystem: crypt for epoch 0 file = sled-storage/src/dataset.rs:259
4202025-01-17T08:20:23.551ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e) file = sled-agent/src/probe_manager.rs:231 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4212025-01-17T08:20:23.584ZINFOSledAgent (StorageResources): Zeroed and unlinked keyfile /var/run/oxide/synthetic-vendor-synthetic-serial-8-synthetic-model-U2-zfs-aes-256-gcm.key file = sled-storage/src/keyfile.rs:53
4222025-01-17T08:20:23.592ZINFOSledAgent (StorageResources): Automatically destroying dataset: oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crypt/zone file = sled-storage/src/dataset.rs:302
4232025-01-17T08:20:23.735ZINFOSledAgent (StorageResources): Looking for unencrypted datasets in oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 file = sled-storage/src/dataset.rs:388
4242025-01-17T08:20:23.742ZINFOSledAgent (StorageResources): Disk::new completed successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:440
4252025-01-17T08:20:23.743ZINFOSledAgent (StorageResources): Disk management started successfully disk_identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" } file = sled-storage/src/resources.rs:357
4262025-01-17T08:20:23.743ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4272025-01-17T08:20:23.743ZINFOSledAgent (StorageMonitor): Received storage manager update disks = AllDisks { generation: Generation(2), inner: AllDisksInner { values: {DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }, variant: M2, slot: 1024, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: a43cfd5f-429f-4cbf-a67a-3a5aec478829 (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }: ImplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/m2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }, variant: M2, slot: 1025, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 42fa09d5-c2a2-4406-a17f-decf2d82447f (zpool), kind: Internal } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_0.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }, variant: U2, slot: 1026, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_1.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }, variant: U2, slot: 1027, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_2.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }, variant: U2, slot: 1028, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_3.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }, variant: U2, slot: 1029, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_4.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }, variant: U2, slot: 1030, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_5.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }, variant: U2, slot: 1031, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_6.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }, variant: U2, slot: 1032, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_7.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }, variant: U2, slot: 1033, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External } })), DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }: ExplicitlyManaged(Synthetic(SyntheticDisk { raw: RawSyntheticDisk { path: "/scratch/u2_8.vdev", identity: DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }, variant: U2, slot: 1034, firmware: DiskFirmware { active_slot: 1, next_active_slot: None, slot1_read_only: true, number_of_slots: 1, slot_firmware_versions: [Some("SYNTH1")] } }, zpool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External } }))} }, mount_config: MountConfig { root: "/", synthetic_disk_root: "/var/tmp" } } file = sled-agent/src/storage_monitor.rs:93
4282025-01-17T08:20:23.743ZINFOSledAgent (DumpSetup-worker): Updated view of disks core_datasets = 0 debug_datasets = 0 dump_slices = 0 file = sled-agent/src/dump_setup.rs:580
4292025-01-17T08:20:23.743ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
4302025-01-17T08:20:23.743ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/.omicron-physical-disks.json.tmp file = common/src/ledger.rs:199 request = omicron_physical_disks_ensure
4312025-01-17T08:20:23.743ZINFOSledAgent: physical disks ensure: Updated storage file = sled-agent/src/sled_agent.rs:907 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4322025-01-17T08:20:23.743ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
4332025-01-17T08:20:23.743ZINFOSledAgent: physical disks ensure: Propagating new generation of disks file = sled-agent/src/sled_agent.rs:933 generation = Generation(2) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4342025-01-17T08:20:23.743ZINFOSledAgent: physical disks ensure: Updated storage monitor file = sled-agent/src/sled_agent.rs:938 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4352025-01-17T08:20:23.743ZINFOSledAgent: physical disks ensure: Updated zone bundler file = sled-agent/src/sled_agent.rs:943 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4362025-01-17T08:20:23.743ZINFOSledAgent (ProbeManager): use_only_these_disks: Processing new request file = sled-agent/src/probe_manager.rs:122 gen = Generation(2) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4372025-01-17T08:20:23.743ZINFOSledAgent: physical disks ensure: Updated probes file = sled-agent/src/sled_agent.rs:949 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4382025-01-17T08:20:23.743ZINFOSledAgent (InstanceManager): use_only_these_disks: Processing new request file = sled-agent/src/instance_manager.rs:799 gen = Generation(2)
4392025-01-17T08:20:23.743ZINFOSledAgent: physical disks ensure: Updated instances file = sled-agent/src/sled_agent.rs:954 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4402025-01-17T08:20:23.743ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3856284 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57672 req_id = 9052a31f-e4cc-4899-aa76-12a7e6fece6b response_code = 200 uri = /omicron-physical-disks
4412025-01-17T08:20:23.775ZINFOSledAgent (RSS): attempting to set up sled's datasets: DatasetsConfig { generation: Generation(1), datasets: {0417045f-7e52-4448-8f52-a7e57a2f7fde (dataset): DatasetConfig { id: 0417045f-7e52-4448-8f52-a7e57a2f7fde (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08439a41-48c8-47e1-bccb-45d1655b6667 (dataset): DatasetConfig { id: 08439a41-48c8-47e1-bccb-45d1655b6667 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18a1e1e1-8fc1-4ce8-bc28-0cb4c79a8431 (dataset): DatasetConfig { id: 18a1e1e1-8fc1-4ce8-bc28-0cb4c79a8431 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a25fdd2-ca9c-4a47-99d3-9e6f3593da59 (dataset): DatasetConfig { id: 1a25fdd2-ca9c-4a47-99d3-9e6f3593da59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a52503a-d73d-4dda-874e-859f1370238f (dataset): DatasetConfig { id: 1a52503a-d73d-4dda-874e-859f1370238f (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1d5f9166-26c0-457f-a228-491fb276be86 (dataset): DatasetConfig { id: 1d5f9166-26c0-457f-a228-491fb276be86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2057f805-08ac-43fb-99ed-cc1b5d074ba4 (dataset): DatasetConfig { id: 2057f805-08ac-43fb-99ed-cc1b5d074ba4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25b10fcc-7206-4b38-8273-581cf2755ff0 (dataset): DatasetConfig { id: 25b10fcc-7206-4b38-8273-581cf2755ff0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2858d067-8247-4b2a-b2cf-5da33307198f (dataset): DatasetConfig { id: 2858d067-8247-4b2a-b2cf-5da33307198f (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a6fb7c8-01f1-4f25-a2b0-7e9d242ea7bc (dataset): DatasetConfig { id: 2a6fb7c8-01f1-4f25-a2b0-7e9d242ea7bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 37ec422a-5d1f-45c8-9b00-a143e341ea99 (dataset): DatasetConfig { id: 37ec422a-5d1f-45c8-9b00-a143e341ea99 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3a5dc783-9caa-4885-9ce3-6652cc5517b7 (dataset): DatasetConfig { id: 3a5dc783-9caa-4885-9ce3-6652cc5517b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e2960d3-8210-46f5-95d2-135bf3f6b88c (dataset): DatasetConfig { id: 3e2960d3-8210-46f5-95d2-135bf3f6b88c (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ef70393-dd6a-4e6c-b443-28f9aac4fcbf (dataset): DatasetConfig { id: 3ef70393-dd6a-4e6c-b443-28f9aac4fcbf (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 407c032d-fcc8-4bf0-8e92-80c3ba127018 (dataset): DatasetConfig { id: 407c032d-fcc8-4bf0-8e92-80c3ba127018 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 494680a2-0481-49db-9813-a4c736a9f989 (dataset): DatasetConfig { id: 494680a2-0481-49db-9813-a4c736a9f989 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fb4d02a-caa8-43aa-a577-586886f1f86d (dataset): DatasetConfig { id: 4fb4d02a-caa8-43aa-a577-586886f1f86d (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5761bab8-2c9b-4f31-b91c-771661c91a16 (dataset): DatasetConfig { id: 5761bab8-2c9b-4f31-b91c-771661c91a16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 594fb6fd-2f70-4066-b5db-b266b2396246 (dataset): DatasetConfig { id: 594fb6fd-2f70-4066-b5db-b266b2396246 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d5e7e8d-418d-4301-b54d-88c7acbde964 (dataset): DatasetConfig { id: 5d5e7e8d-418d-4301-b54d-88c7acbde964 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e14c6fa-5e70-4afd-b14d-821ff31818c0 (dataset): DatasetConfig { id: 5e14c6fa-5e70-4afd-b14d-821ff31818c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6560e4ba-ac22-4100-ad9e-cbfee8138acb (dataset): DatasetConfig { id: 6560e4ba-ac22-4100-ad9e-cbfee8138acb (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6b4a6c42-66e2-4cb2-b089-9e1a92ecd13d (dataset): DatasetConfig { id: 6b4a6c42-66e2-4cb2-b089-9e1a92ecd13d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d94edbe-4a51-4685-aa1c-569c9b393307 (dataset): DatasetConfig { id: 6d94edbe-4a51-4685-aa1c-569c9b393307 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71667551-41f2-4e8c-9e57-b52385eb2cf3 (dataset): DatasetConfig { id: 71667551-41f2-4e8c-9e57-b52385eb2cf3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 721688af-1654-4131-a177-b2a40fd3be93 (dataset): DatasetConfig { id: 721688af-1654-4131-a177-b2a40fd3be93 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 725bcafa-9891-430e-b444-9a1c852f72b6 (dataset): DatasetConfig { id: 725bcafa-9891-430e-b444-9a1c852f72b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cd80de7-1b2a-4556-8ab2-fd00611c7dfa (dataset): DatasetConfig { id: 7cd80de7-1b2a-4556-8ab2-fd00611c7dfa (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8055d8e1-396e-473c-a4b7-950e79c127d3 (dataset): DatasetConfig { id: 8055d8e1-396e-473c-a4b7-950e79c127d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82fd8559-bebd-4106-91ea-3a98f2fa8fb6 (dataset): DatasetConfig { id: 82fd8559-bebd-4106-91ea-3a98f2fa8fb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8be12067-bfc0-402e-8b24-0efde092a1c3 (dataset): DatasetConfig { id: 8be12067-bfc0-402e-8b24-0efde092a1c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e2d0e0e-318a-490f-a672-a5933925ddba (dataset): DatasetConfig { id: 8e2d0e0e-318a-490f-a672-a5933925ddba (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e406a1b-f3b6-488d-8113-5b8e9ef9e8a1 (dataset): DatasetConfig { id: 8e406a1b-f3b6-488d-8113-5b8e9ef9e8a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94496fc6-d1df-4331-977f-699a24b3228b (dataset): DatasetConfig { id: 94496fc6-d1df-4331-977f-699a24b3228b (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94f0bbbe-0705-46ee-9ee3-0b0b2a2a3b91 (dataset): DatasetConfig { id: 94f0bbbe-0705-46ee-9ee3-0b0b2a2a3b91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96e49982-749c-44fe-9a55-f1ea33e954ca (dataset): DatasetConfig { id: 96e49982-749c-44fe-9a55-f1ea33e954ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892923b-5938-4419-aa70-62c2bb963a3c (dataset): DatasetConfig { id: 9892923b-5938-4419-aa70-62c2bb963a3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0f48730-ba5b-4128-9150-b33b6d47662a (dataset): DatasetConfig { id: a0f48730-ba5b-4128-9150-b33b6d47662a (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b23951de-5256-4000-b7f0-03432d2e6f5d (dataset): DatasetConfig { id: b23951de-5256-4000-b7f0-03432d2e6f5d (dataset), name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3e9d2a7-0667-4867-a29d-3f038f5eac21 (dataset): DatasetConfig { id: b3e9d2a7-0667-4867-a29d-3f038f5eac21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6313a5f-e0c7-42f4-8a94-c5f82f040ba0 (dataset): DatasetConfig { id: b6313a5f-e0c7-42f4-8a94-c5f82f040ba0 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b79c123f-7b25-4de9-af11-b69a0c281188 (dataset): DatasetConfig { id: b79c123f-7b25-4de9-af11-b69a0c281188 (dataset), name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8edb2fc-4a39-4806-81d7-cbb2cc5cd4c8 (dataset): DatasetConfig { id: b8edb2fc-4a39-4806-81d7-cbb2cc5cd4c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9cb9500-9051-4a01-9859-1cb050fde932 (dataset): DatasetConfig { id: b9cb9500-9051-4a01-9859-1cb050fde932 (dataset), name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb62da1b-0348-4fe8-a3c3-3f8818715f17 (dataset): DatasetConfig { id: bb62da1b-0348-4fe8-a3c3-3f8818715f17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd8cad21-90f8-4a71-b623-2503db1a02b6 (dataset): DatasetConfig { id: bd8cad21-90f8-4a71-b623-2503db1a02b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bed9a4e1-9030-4b31-a870-223be51c44fe (dataset): DatasetConfig { id: bed9a4e1-9030-4b31-a870-223be51c44fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfd72a7c-9021-4a32-8b72-6a2809cd2570 (dataset): DatasetConfig { id: bfd72a7c-9021-4a32-8b72-6a2809cd2570 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c31f511e-2601-4841-a2c4-1c6b159df411 (dataset): DatasetConfig { id: c31f511e-2601-4841-a2c4-1c6b159df411 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3d9a958-a6d1-4bd6-8094-446328b7b9f6 (dataset): DatasetConfig { id: c3d9a958-a6d1-4bd6-8094-446328b7b9f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c7b3dd36-209d-475b-b600-7ca74124e69e (dataset): DatasetConfig { id: c7b3dd36-209d-475b-b600-7ca74124e69e (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c863bda4-b6de-4936-b9be-75431087f641 (dataset): DatasetConfig { id: c863bda4-b6de-4936-b9be-75431087f641 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca75f4e7-00aa-4adf-90c7-5b53ac53adae (dataset): DatasetConfig { id: ca75f4e7-00aa-4adf-90c7-5b53ac53adae (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc49f9b3-1913-4ba2-8a1c-2e0bf57334f0 (dataset): DatasetConfig { id: cc49f9b3-1913-4ba2-8a1c-2e0bf57334f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6a77c5b-3816-406d-a7d6-6ae27061c3ba (dataset): DatasetConfig { id: d6a77c5b-3816-406d-a7d6-6ae27061c3ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e093441b-f3b4-41a8-a23e-c13749429d67 (dataset): DatasetConfig { id: e093441b-f3b4-41a8-a23e-c13749429d67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1111f60-b360-4c7e-b84a-c0888b67056a (dataset): DatasetConfig { id: e1111f60-b360-4c7e-b84a-c0888b67056a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edcad3d9-837f-4e27-8e2f-bd65466b074e (dataset): DatasetConfig { id: edcad3d9-837f-4e27-8e2f-bd65466b074e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee012cff-a190-4e84-968d-2c54bb72bd69 (dataset): DatasetConfig { id: ee012cff-a190-4e84-968d-2c54bb72bd69 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efb7e0d4-1a42-4c6f-9cb6-d2286216c9ea (dataset): DatasetConfig { id: efb7e0d4-1a42-4c6f-9cb6-d2286216c9ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efb8914a-9abc-43c1-9580-50de938fbab7 (dataset): DatasetConfig { id: efb8914a-9abc-43c1-9580-50de938fbab7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f086485e-fbbb-4bdf-83a4-8a561583dba7 (dataset): DatasetConfig { id: f086485e-fbbb-4bdf-83a4-8a561583dba7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2461d32-0590-4a4f-819f-a89b7b120b0a (dataset): DatasetConfig { id: f2461d32-0590-4a4f-819f-a89b7b120b0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f404217b-5e49-401e-9d30-4d56d9586d24 (dataset): DatasetConfig { id: f404217b-5e49-401e-9d30-4d56d9586d24 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc15a65e-b108-48d2-88fe-91a624051392 (dataset): DatasetConfig { id: fc15a65e-b108-48d2-88fe-91a624051392 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff077e71-1519-4b8f-9503-b02602579566 (dataset): DatasetConfig { id: ff077e71-1519-4b8f-9503-b02602579566 (dataset), name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} } file = sled-agent/src/rack_setup/service.rs:460 sled_address = [fd00:1122:3344:101::1]:12345
4422025-01-17T08:20:23.775ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61180
4432025-01-17T08:20:23.775ZINFOSledAgent: datasets ensure file = sled-agent/src/sled_agent.rs:869 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
4442025-01-17T08:20:23.775ZINFOSledAgent (StorageManager): Received DatasetsEnsure { config: DatasetsConfig { generation: Generation(1), datasets: {0417045f-7e52-4448-8f52-a7e57a2f7fde (dataset): DatasetConfig { id: 0417045f-7e52-4448-8f52-a7e57a2f7fde (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 08439a41-48c8-47e1-bccb-45d1655b6667 (dataset): DatasetConfig { id: 08439a41-48c8-47e1-bccb-45d1655b6667 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 18a1e1e1-8fc1-4ce8-bc28-0cb4c79a8431 (dataset): DatasetConfig { id: 18a1e1e1-8fc1-4ce8-bc28-0cb4c79a8431 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 1a25fdd2-ca9c-4a47-99d3-9e6f3593da59 (dataset): DatasetConfig { id: 1a25fdd2-ca9c-4a47-99d3-9e6f3593da59 (dataset), name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1a52503a-d73d-4dda-874e-859f1370238f (dataset): DatasetConfig { id: 1a52503a-d73d-4dda-874e-859f1370238f (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 1d5f9166-26c0-457f-a228-491fb276be86 (dataset): DatasetConfig { id: 1d5f9166-26c0-457f-a228-491fb276be86 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2057f805-08ac-43fb-99ed-cc1b5d074ba4 (dataset): DatasetConfig { id: 2057f805-08ac-43fb-99ed-cc1b5d074ba4 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 25b10fcc-7206-4b38-8273-581cf2755ff0 (dataset): DatasetConfig { id: 25b10fcc-7206-4b38-8273-581cf2755ff0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2858d067-8247-4b2a-b2cf-5da33307198f (dataset): DatasetConfig { id: 2858d067-8247-4b2a-b2cf-5da33307198f (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 2a6fb7c8-01f1-4f25-a2b0-7e9d242ea7bc (dataset): DatasetConfig { id: 2a6fb7c8-01f1-4f25-a2b0-7e9d242ea7bc (dataset), name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 37ec422a-5d1f-45c8-9b00-a143e341ea99 (dataset): DatasetConfig { id: 37ec422a-5d1f-45c8-9b00-a143e341ea99 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 3a5dc783-9caa-4885-9ce3-6652cc5517b7 (dataset): DatasetConfig { id: 3a5dc783-9caa-4885-9ce3-6652cc5517b7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3e2960d3-8210-46f5-95d2-135bf3f6b88c (dataset): DatasetConfig { id: 3e2960d3-8210-46f5-95d2-135bf3f6b88c (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 3ef70393-dd6a-4e6c-b443-28f9aac4fcbf (dataset): DatasetConfig { id: 3ef70393-dd6a-4e6c-b443-28f9aac4fcbf (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 407c032d-fcc8-4bf0-8e92-80c3ba127018 (dataset): DatasetConfig { id: 407c032d-fcc8-4bf0-8e92-80c3ba127018 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 494680a2-0481-49db-9813-a4c736a9f989 (dataset): DatasetConfig { id: 494680a2-0481-49db-9813-a4c736a9f989 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 4fb4d02a-caa8-43aa-a577-586886f1f86d (dataset): DatasetConfig { id: 4fb4d02a-caa8-43aa-a577-586886f1f86d (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5761bab8-2c9b-4f31-b91c-771661c91a16 (dataset): DatasetConfig { id: 5761bab8-2c9b-4f31-b91c-771661c91a16 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 594fb6fd-2f70-4066-b5db-b266b2396246 (dataset): DatasetConfig { id: 594fb6fd-2f70-4066-b5db-b266b2396246 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5d5e7e8d-418d-4301-b54d-88c7acbde964 (dataset): DatasetConfig { id: 5d5e7e8d-418d-4301-b54d-88c7acbde964 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 5e14c6fa-5e70-4afd-b14d-821ff31818c0 (dataset): DatasetConfig { id: 5e14c6fa-5e70-4afd-b14d-821ff31818c0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: ExternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6560e4ba-ac22-4100-ad9e-cbfee8138acb (dataset): DatasetConfig { id: 6560e4ba-ac22-4100-ad9e-cbfee8138acb (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 6b4a6c42-66e2-4cb2-b089-9e1a92ecd13d (dataset): DatasetConfig { id: 6b4a6c42-66e2-4cb2-b089-9e1a92ecd13d (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 6d94edbe-4a51-4685-aa1c-569c9b393307 (dataset): DatasetConfig { id: 6d94edbe-4a51-4685-aa1c-569c9b393307 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 71667551-41f2-4e8c-9e57-b52385eb2cf3 (dataset): DatasetConfig { id: 71667551-41f2-4e8c-9e57-b52385eb2cf3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 721688af-1654-4131-a177-b2a40fd3be93 (dataset): DatasetConfig { id: 721688af-1654-4131-a177-b2a40fd3be93 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 725bcafa-9891-430e-b444-9a1c852f72b6 (dataset): DatasetConfig { id: 725bcafa-9891-430e-b444-9a1c852f72b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 7cd80de7-1b2a-4556-8ab2-fd00611c7dfa (dataset): DatasetConfig { id: 7cd80de7-1b2a-4556-8ab2-fd00611c7dfa (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8055d8e1-396e-473c-a4b7-950e79c127d3 (dataset): DatasetConfig { id: 8055d8e1-396e-473c-a4b7-950e79c127d3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 82fd8559-bebd-4106-91ea-3a98f2fa8fb6 (dataset): DatasetConfig { id: 82fd8559-bebd-4106-91ea-3a98f2fa8fb6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, 8be12067-bfc0-402e-8b24-0efde092a1c3 (dataset): DatasetConfig { id: 8be12067-bfc0-402e-8b24-0efde092a1c3 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e2d0e0e-318a-490f-a672-a5933925ddba (dataset): DatasetConfig { id: 8e2d0e0e-318a-490f-a672-a5933925ddba (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 8e406a1b-f3b6-488d-8113-5b8e9ef9e8a1 (dataset): DatasetConfig { id: 8e406a1b-f3b6-488d-8113-5b8e9ef9e8a1 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94496fc6-d1df-4331-977f-699a24b3228b (dataset): DatasetConfig { id: 94496fc6-d1df-4331-977f-699a24b3228b (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 94f0bbbe-0705-46ee-9ee3-0b0b2a2a3b91 (dataset): DatasetConfig { id: 94f0bbbe-0705-46ee-9ee3-0b0b2a2a3b91 (dataset), name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 96e49982-749c-44fe-9a55-f1ea33e954ca (dataset): DatasetConfig { id: 96e49982-749c-44fe-9a55-f1ea33e954ca (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, 9892923b-5938-4419-aa70-62c2bb963a3c (dataset): DatasetConfig { id: 9892923b-5938-4419-aa70-62c2bb963a3c (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, a0f48730-ba5b-4128-9150-b33b6d47662a (dataset): DatasetConfig { id: a0f48730-ba5b-4128-9150-b33b6d47662a (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b23951de-5256-4000-b7f0-03432d2e6f5d (dataset): DatasetConfig { id: b23951de-5256-4000-b7f0-03432d2e6f5d (dataset), name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b3e9d2a7-0667-4867-a29d-3f038f5eac21 (dataset): DatasetConfig { id: b3e9d2a7-0667-4867-a29d-3f038f5eac21 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: TransientZone { name: "oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b6313a5f-e0c7-42f4-8a94-c5f82f040ba0 (dataset): DatasetConfig { id: b6313a5f-e0c7-42f4-8a94-c5f82f040ba0 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b79c123f-7b25-4de9-af11-b69a0c281188 (dataset): DatasetConfig { id: b79c123f-7b25-4de9-af11-b69a0c281188 (dataset), name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b8edb2fc-4a39-4806-81d7-cbb2cc5cd4c8 (dataset): DatasetConfig { id: b8edb2fc-4a39-4806-81d7-cbb2cc5cd4c8 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, b9cb9500-9051-4a01-9859-1cb050fde932 (dataset): DatasetConfig { id: b9cb9500-9051-4a01-9859-1cb050fde932 (dataset), name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bb62da1b-0348-4fe8-a3c3-3f8818715f17 (dataset): DatasetConfig { id: bb62da1b-0348-4fe8-a3c3-3f8818715f17 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bd8cad21-90f8-4a71-b623-2503db1a02b6 (dataset): DatasetConfig { id: bd8cad21-90f8-4a71-b623-2503db1a02b6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, bed9a4e1-9030-4b31-a870-223be51c44fe (dataset): DatasetConfig { id: bed9a4e1-9030-4b31-a870-223be51c44fe (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, bfd72a7c-9021-4a32-8b72-6a2809cd2570 (dataset): DatasetConfig { id: bfd72a7c-9021-4a32-8b72-6a2809cd2570 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c31f511e-2601-4841-a2c4-1c6b159df411 (dataset): DatasetConfig { id: c31f511e-2601-4841-a2c4-1c6b159df411 (dataset), name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, c3d9a958-a6d1-4bd6-8094-446328b7b9f6 (dataset): DatasetConfig { id: c3d9a958-a6d1-4bd6-8094-446328b7b9f6 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c7b3dd36-209d-475b-b600-7ca74124e69e (dataset): DatasetConfig { id: c7b3dd36-209d-475b-b600-7ca74124e69e (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Debug }, inner: SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } }, c863bda4-b6de-4936-b9be-75431087f641 (dataset): DatasetConfig { id: c863bda4-b6de-4936-b9be-75431087f641 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ca75f4e7-00aa-4adf-90c7-5b53ac53adae (dataset): DatasetConfig { id: ca75f4e7-00aa-4adf-90c7-5b53ac53adae (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, cc49f9b3-1913-4ba2-8a1c-2e0bf57334f0 (dataset): DatasetConfig { id: cc49f9b3-1913-4ba2-8a1c-2e0bf57334f0 (dataset), name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, d6a77c5b-3816-406d-a7d6-6ae27061c3ba (dataset): DatasetConfig { id: d6a77c5b-3816-406d-a7d6-6ae27061c3ba (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e093441b-f3b4-41a8-a23e-c13749429d67 (dataset): DatasetConfig { id: e093441b-f3b4-41a8-a23e-c13749429d67 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZoneRoot }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, e1111f60-b360-4c7e-b84a-c0888b67056a (dataset): DatasetConfig { id: e1111f60-b360-4c7e-b84a-c0888b67056a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, edcad3d9-837f-4e27-8e2f-bd65466b074e (dataset): DatasetConfig { id: edcad3d9-837f-4e27-8e2f-bd65466b074e (dataset), name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: TransientZone { name: "oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ee012cff-a190-4e84-968d-2c54bb72bd69 (dataset): DatasetConfig { id: ee012cff-a190-4e84-968d-2c54bb72bd69 (dataset), name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efb7e0d4-1a42-4c6f-9cb6-d2286216c9ea (dataset): DatasetConfig { id: efb7e0d4-1a42-4c6f-9cb6-d2286216c9ea (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: TransientZone { name: "oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, efb8914a-9abc-43c1-9580-50de938fbab7 (dataset): DatasetConfig { id: efb8914a-9abc-43c1-9580-50de938fbab7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: TransientZone { name: "oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f086485e-fbbb-4bdf-83a4-8a561583dba7 (dataset): DatasetConfig { id: f086485e-fbbb-4bdf-83a4-8a561583dba7 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Cockroach }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f2461d32-0590-4a4f-819f-a89b7b120b0a (dataset): DatasetConfig { id: f2461d32-0590-4a4f-819f-a89b7b120b0a (dataset), name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Clickhouse }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, f404217b-5e49-401e-9d30-4d56d9586d24 (dataset): DatasetConfig { id: f404217b-5e49-401e-9d30-4d56d9586d24 (dataset), name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: TransientZone { name: "oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d" } }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, fc15a65e-b108-48d2-88fe-91a624051392 (dataset): DatasetConfig { id: fc15a65e-b108-48d2-88fe-91a624051392 (dataset), name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }, ff077e71-1519-4b8f-9503-b02602579566 (dataset): DatasetConfig { id: ff077e71-1519-4b8f-9503-b02602579566 (dataset), name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: Crucible }, inner: SharedDatasetConfig { compression: Off, quota: None, reservation: None } }} }, tx: ... } file = sled-storage/src/manager.rs:607
4452025-01-17T08:20:23.775ZINFOSledAgent (StorageManager): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4462025-01-17T08:20:23.775ZINFOSledAgent (StorageManager): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-datasets.json file = common/src/ledger.rs:188 request = datasets_ensure
4472025-01-17T08:20:23.775ZINFOSledAgent (StorageManager): No previously-stored 'requested datasets', creating new ledger file = sled-storage/src/manager.rs:909 request = datasets_ensure
4482025-01-17T08:20:23.791ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4492025-01-17T08:20:23.791ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4502025-01-17T08:20:23.791ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46" } file = sled-storage/src/manager.rs:1431
4512025-01-17T08:20:23.863ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4522025-01-17T08:20:23.863ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4532025-01-17T08:20:23.863ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crucible" } file = sled-storage/src/manager.rs:1431
4542025-01-17T08:20:23.912ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4552025-01-17T08:20:23.912ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4562025-01-17T08:20:23.912ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone" } file = sled-storage/src/manager.rs:1431
4572025-01-17T08:20:23.942ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4582025-01-17T08:20:23.942ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4592025-01-17T08:20:23.942ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crypt/debug"), full_name: "oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crypt/debug" } file = sled-storage/src/manager.rs:1431
4602025-01-17T08:20:23.972ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4612025-01-17T08:20:23.972ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4622025-01-17T08:20:23.972ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/debug"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/debug" } file = sled-storage/src/manager.rs:1431
4632025-01-17T08:20:24.000ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4642025-01-17T08:20:24.000ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4652025-01-17T08:20:24.001ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone" } file = sled-storage/src/manager.rs:1431
4662025-01-17T08:20:24.031ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4672025-01-17T08:20:24.031ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4682025-01-17T08:20:24.031ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
4692025-01-17T08:20:24.082ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4702025-01-17T08:20:24.082ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4712025-01-17T08:20:24.082ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crypt/zone/oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb"), full_name: "oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crypt/zone/oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb" } file = sled-storage/src/manager.rs:1431
4722025-01-17T08:20:24.139ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4732025-01-17T08:20:24.139ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4742025-01-17T08:20:24.139ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/zone/oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b"), full_name: "oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/zone/oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b" } file = sled-storage/src/manager.rs:1431
4752025-01-17T08:20:24.198ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4762025-01-17T08:20:24.198ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4772025-01-17T08:20:24.198ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crypt/debug"), full_name: "oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crypt/debug" } file = sled-storage/src/manager.rs:1431
4782025-01-17T08:20:24.227ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4792025-01-17T08:20:24.227ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
4802025-01-17T08:20:24.227ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/77842ceb-2fab-4804-a283-1a7c8f995913/crypt/debug"), full_name: "oxp_77842ceb-2fab-4804-a283-1a7c8f995913/crypt/debug" } file = sled-storage/src/manager.rs:1431
4812025-01-17T08:20:24.255ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4822025-01-17T08:20:24.255ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4832025-01-17T08:20:24.255ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
4842025-01-17T08:20:24.302ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4852025-01-17T08:20:24.302ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4862025-01-17T08:20:24.302ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/zone/oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5"), full_name: "oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/zone/oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5" } file = sled-storage/src/manager.rs:1431
4872025-01-17T08:20:24.361ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4882025-01-17T08:20:24.361ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4892025-01-17T08:20:24.361ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crucible" } file = sled-storage/src/manager.rs:1431
4902025-01-17T08:20:24.409ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4912025-01-17T08:20:24.409ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4922025-01-17T08:20:24.409ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63" } file = sled-storage/src/manager.rs:1431
4932025-01-17T08:20:24.468ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4942025-01-17T08:20:24.468ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4952025-01-17T08:20:24.468ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone/oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f"), full_name: "oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone/oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f" } file = sled-storage/src/manager.rs:1431
4962025-01-17T08:20:24.527ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
4972025-01-17T08:20:24.527ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
4982025-01-17T08:20:24.527ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739/crucible" } file = sled-storage/src/manager.rs:1431
4992025-01-17T08:20:24.556ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e) file = sled-agent/src/probe_manager.rs:231 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
5002025-01-17T08:20:24.573ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5012025-01-17T08:20:24.573ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5022025-01-17T08:20:24.573ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/zone/oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c"), full_name: "oxp_0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/zone/oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c" } file = sled-storage/src/manager.rs:1431
5032025-01-17T08:20:24.630ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5042025-01-17T08:20:24.630ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5052025-01-17T08:20:24.630ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone/oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951"), full_name: "oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone/oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951" } file = sled-storage/src/manager.rs:1431
5062025-01-17T08:20:24.688ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5072025-01-17T08:20:24.688ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5082025-01-17T08:20:24.688ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525" } file = sled-storage/src/manager.rs:1431
5092025-01-17T08:20:24.745ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5102025-01-17T08:20:24.745ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5112025-01-17T08:20:24.745ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/external_dns" } file = sled-storage/src/manager.rs:1431
5122025-01-17T08:20:24.793ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5132025-01-17T08:20:24.793ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5142025-01-17T08:20:24.793ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/debug"), full_name: "oxp_0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/debug" } file = sled-storage/src/manager.rs:1431
5152025-01-17T08:20:24.822ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5162025-01-17T08:20:24.822ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5172025-01-17T08:20:24.822ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb" } file = sled-storage/src/manager.rs:1431
5182025-01-17T08:20:24.881ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5192025-01-17T08:20:24.881ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5202025-01-17T08:20:24.881ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/zone/oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3"), full_name: "oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/zone/oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3" } file = sled-storage/src/manager.rs:1431
5212025-01-17T08:20:24.942ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5222025-01-17T08:20:24.942ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5232025-01-17T08:20:24.942ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_77842ceb-2fab-4804-a283-1a7c8f995913/crucible" } file = sled-storage/src/manager.rs:1431
5242025-01-17T08:20:24.990ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5252025-01-17T08:20:24.990ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5262025-01-17T08:20:24.990ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crucible" } file = sled-storage/src/manager.rs:1431
5272025-01-17T08:20:25.037ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5282025-01-17T08:20:25.037ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5292025-01-17T08:20:25.037ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a" } file = sled-storage/src/manager.rs:1431
5302025-01-17T08:20:25.097ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5312025-01-17T08:20:25.097ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5322025-01-17T08:20:25.097ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706" } file = sled-storage/src/manager.rs:1431
5332025-01-17T08:20:25.155ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5342025-01-17T08:20:25.155ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5352025-01-17T08:20:25.155ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5362025-01-17T08:20:25.205ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5372025-01-17T08:20:25.205ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5382025-01-17T08:20:25.205ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/debug"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/debug" } file = sled-storage/src/manager.rs:1431
5392025-01-17T08:20:25.233ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5402025-01-17T08:20:25.233ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5412025-01-17T08:20:25.233ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5422025-01-17T08:20:25.280ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5432025-01-17T08:20:25.280ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5442025-01-17T08:20:25.280ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/zone"), full_name: "oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/zone" } file = sled-storage/src/manager.rs:1431
5452025-01-17T08:20:25.310ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5462025-01-17T08:20:25.310ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5472025-01-17T08:20:25.310ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/77842ceb-2fab-4804-a283-1a7c8f995913/crypt/zone"), full_name: "oxp_77842ceb-2fab-4804-a283-1a7c8f995913/crypt/zone" } file = sled-storage/src/manager.rs:1431
5482025-01-17T08:20:25.339ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5492025-01-17T08:20:25.339ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5502025-01-17T08:20:25.339ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219" } file = sled-storage/src/manager.rs:1431
5512025-01-17T08:20:25.398ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5522025-01-17T08:20:25.398ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5532025-01-17T08:20:25.398ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crypt/zone"), full_name: "oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crypt/zone" } file = sled-storage/src/manager.rs:1431
5542025-01-17T08:20:25.427ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5552025-01-17T08:20:25.427ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5562025-01-17T08:20:25.427ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crucible" } file = sled-storage/src/manager.rs:1431
5572025-01-17T08:20:25.474ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5582025-01-17T08:20:25.474ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5592025-01-17T08:20:25.474ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f" } file = sled-storage/src/manager.rs:1431
5602025-01-17T08:20:25.532ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5612025-01-17T08:20:25.532ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5622025-01-17T08:20:25.532ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
5632025-01-17T08:20:25.558ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e) file = sled-agent/src/probe_manager.rs:231 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
5642025-01-17T08:20:25.580ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5652025-01-17T08:20:25.580ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5662025-01-17T08:20:25.580ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crypt/zone"), full_name: "oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crypt/zone" } file = sled-storage/src/manager.rs:1431
5672025-01-17T08:20:25.608ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5682025-01-17T08:20:25.608ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5692025-01-17T08:20:25.608ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/77842ceb-2fab-4804-a283-1a7c8f995913/crypt/zone/oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8"), full_name: "oxp_77842ceb-2fab-4804-a283-1a7c8f995913/crypt/zone/oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8" } file = sled-storage/src/manager.rs:1431
5702025-01-17T08:20:25.667ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5712025-01-17T08:20:25.667ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5722025-01-17T08:20:25.667ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/zone"), full_name: "oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/zone" } file = sled-storage/src/manager.rs:1431
5732025-01-17T08:20:25.695ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5742025-01-17T08:20:25.695ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5752025-01-17T08:20:25.695ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crypt/zone/oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d"), full_name: "oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crypt/zone/oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d" } file = sled-storage/src/manager.rs:1431
5762025-01-17T08:20:25.748ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5772025-01-17T08:20:25.748ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5782025-01-17T08:20:25.748ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/internal_dns" } file = sled-storage/src/manager.rs:1431
5792025-01-17T08:20:25.797ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5802025-01-17T08:20:25.797ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5812025-01-17T08:20:25.797ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crucible" } file = sled-storage/src/manager.rs:1431
5822025-01-17T08:20:25.845ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5832025-01-17T08:20:25.845ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5842025-01-17T08:20:25.845ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone/oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078"), full_name: "oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone/oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078" } file = sled-storage/src/manager.rs:1431
5852025-01-17T08:20:25.900ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5862025-01-17T08:20:25.900ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5872025-01-17T08:20:25.900ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/debug"), full_name: "oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/debug" } file = sled-storage/src/manager.rs:1431
5882025-01-17T08:20:25.928ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5892025-01-17T08:20:25.928ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5902025-01-17T08:20:25.928ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175" } file = sled-storage/src/manager.rs:1431
5912025-01-17T08:20:25.985ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5922025-01-17T08:20:25.985ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5932025-01-17T08:20:25.985ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/zone"), full_name: "oxp_0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/zone" } file = sled-storage/src/manager.rs:1431
5942025-01-17T08:20:26.015ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5952025-01-17T08:20:26.015ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
5962025-01-17T08:20:26.015ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/zone/oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a"), full_name: "oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/zone/oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a" } file = sled-storage/src/manager.rs:1431
5972025-01-17T08:20:26.076ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
5982025-01-17T08:20:26.076ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
5992025-01-17T08:20:26.076ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/debug"), full_name: "oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/debug" } file = sled-storage/src/manager.rs:1431
6002025-01-17T08:20:26.104ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6012025-01-17T08:20:26.104ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6022025-01-17T08:20:26.104ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: GzipN { level: GzipLevel(9) }, quota: Some(ByteCount(107374182400)), reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/debug"), full_name: "oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/debug" } file = sled-storage/src/manager.rs:1431
6032025-01-17T08:20:26.133ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6042025-01-17T08:20:26.133ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6052025-01-17T08:20:26.133ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/zone/oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32"), full_name: "oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/zone/oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32" } file = sled-storage/src/manager.rs:1431
6062025-01-17T08:20:26.193ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6072025-01-17T08:20:26.193ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6082025-01-17T08:20:26.194ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/77842ceb-2fab-4804-a283-1a7c8f995913/crypt/zone/oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3"), full_name: "oxp_77842ceb-2fab-4804-a283-1a7c8f995913/crypt/zone/oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3" } file = sled-storage/src/manager.rs:1431
6092025-01-17T08:20:26.252ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6102025-01-17T08:20:26.252ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6112025-01-17T08:20:26.252ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/77842ceb-2fab-4804-a283-1a7c8f995913/crypt/zone/oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426"), full_name: "oxp_77842ceb-2fab-4804-a283-1a7c8f995913/crypt/zone/oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426" } file = sled-storage/src/manager.rs:1431
6122025-01-17T08:20:26.314ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6132025-01-17T08:20:26.314ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6142025-01-17T08:20:26.314ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6152025-01-17T08:20:26.363ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6162025-01-17T08:20:26.363ZINFOSledAgent (StorageManager): Old properties missing UUID file = sled-storage/src/manager.rs:998 request = datasets_ensure
6172025-01-17T08:20:26.363ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone"), full_name: "oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone" } file = sled-storage/src/manager.rs:1431
6182025-01-17T08:20:26.392ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6192025-01-17T08:20:26.392ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6202025-01-17T08:20:26.392ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6" } file = sled-storage/src/manager.rs:1431
6212025-01-17T08:20:26.452ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6222025-01-17T08:20:26.452ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6232025-01-17T08:20:26.452ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone/oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd"), full_name: "oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/zone/oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd" } file = sled-storage/src/manager.rs:1431
6242025-01-17T08:20:26.511ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6252025-01-17T08:20:26.511ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6262025-01-17T08:20:26.511ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6272025-01-17T08:20:26.560ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e) file = sled-agent/src/probe_manager.rs:231 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
6282025-01-17T08:20:26.560ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6292025-01-17T08:20:26.560ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6302025-01-17T08:20:26.560ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/zone/oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11"), full_name: "oxp_0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/zone/oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11" } file = sled-storage/src/manager.rs:1431
6312025-01-17T08:20:26.621ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6322025-01-17T08:20:26.621ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6332025-01-17T08:20:26.621ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/zone/oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a" } file = sled-storage/src/manager.rs:1431
6342025-01-17T08:20:26.681ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6352025-01-17T08:20:26.681ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6362025-01-17T08:20:26.681ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/cockroachdb" } file = sled-storage/src/manager.rs:1431
6372025-01-17T08:20:26.729ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6382025-01-17T08:20:26.729ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6392025-01-17T08:20:26.729ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/clickhouse" } file = sled-storage/src/manager.rs:1431
6402025-01-17T08:20:26.778ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6412025-01-17T08:20:26.778ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6422025-01-17T08:20:26.778ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: false, mountpoint: Path("/pool/ext/50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), full_name: "oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/zone/oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d" } file = sled-storage/src/manager.rs:1431
6432025-01-17T08:20:26.835ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6442025-01-17T08:20:26.835ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6452025-01-17T08:20:26.835ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_0ab7c39f-5947-4112-8347-2ecc105352ff/crucible" } file = sled-storage/src/manager.rs:1431
6462025-01-17T08:20:26.883ZINFOSledAgent (StorageManager): Ensuring dataset file = sled-storage/src/manager.rs:1039 request = datasets_ensure
6472025-01-17T08:20:26.883ZINFOSledAgent (StorageManager): This dataset did not exist file = sled-storage/src/manager.rs:993 request = datasets_ensure
6482025-01-17T08:20:26.883ZINFOSledAgent (StorageManager): ensure_dataset config = SharedDatasetConfig { compression: Off, quota: None, reservation: None } details = DatasetCreationDetails { zoned: true, mountpoint: Path("/data"), full_name: "oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crucible" } file = sled-storage/src/manager.rs:1431
6492025-01-17T08:20:26.931ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6502025-01-17T08:20:26.931ZINFOSledAgent (StorageManager): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/.omicron-datasets.json.tmp file = common/src/ledger.rs:199 request = datasets_ensure
6512025-01-17T08:20:26.932ZINFOSledAgent: datasets ensure: Updated storage file = sled-agent/src/sled_agent.rs:871 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
6522025-01-17T08:20:26.932ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 3156894 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:61180 req_id = 7b1af52c-95a9-47b5-85be-4d1fba5176cf response_code = 200 uri = /datasets
6532025-01-17T08:20:26.964ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(2), zones: [OmicronZoneConfig { id: 031d4967-d152-46af-88a4-eb487b5c2f7a (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c6ef6b3a-8349-47f8-94bf-cee694328219 (service), filesystem_pool: Some(ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 25507f08-a286-439f-b2a0-e23f9b5d951a (service), filesystem_pool: Some(ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
6542025-01-17T08:20:26.964ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:52411
6552025-01-17T08:20:26.964ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6562025-01-17T08:20:26.964ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, responder: ... }
6572025-01-17T08:20:26.973ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6582025-01-17T08:20:26.973ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, responder: ... }
6592025-01-17T08:20:26.981ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
6602025-01-17T08:20:26.981ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
6612025-01-17T08:20:26.989ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6622025-01-17T08:20:26.989ZINFOSledAgent (ServiceManager): No ledger in /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:188
6632025-01-17T08:20:26.989ZINFOSledAgent (ServiceManager): No ledger in /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:188
6642025-01-17T08:20:26.989ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6652025-01-17T08:20:27.033ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6662025-01-17T08:20:27.033ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6672025-01-17T08:20:27.033ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
6682025-01-17T08:20:27.088ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219 file = illumos-utils/src/zone.rs:325
6692025-01-17T08:20:27.092ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a file = illumos-utils/src/zone.rs:325
6702025-01-17T08:20:27.095ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a file = illumos-utils/src/zone.rs:325
6712025-01-17T08:20:27.108ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219 file = illumos-utils/src/zone.rs:363
6722025-01-17T08:20:27.113ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a file = illumos-utils/src/zone.rs:363
6732025-01-17T08:20:27.116ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a file = illumos-utils/src/zone.rs:363
6742025-01-17T08:20:27.562ZERROSledAgent (ProbeManager): get target probe state: Communication Error: error sending request for url (http://_nexus._tcp.control-plane.oxide.internal:12221/probes/fbac3378-7daf-4aef-b0f5-d2cd5264f30e) file = sled-agent/src/probe_manager.rs:231 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
6752025-01-17T08:20:28.724ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService2'/> <propval type="astring" name="gateway" value='fd00:1122:3344:1::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:1::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:1::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:1::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6762025-01-17T08:20:28.724ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:1::, width: 64 }
6772025-01-17T08:20:29.203ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService1'/> <propval type="astring" name="gateway" value='fd00:1122:3344:2::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:2::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:2::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:2::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6782025-01-17T08:20:29.203ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
6792025-01-17T08:20:29.367ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16418583778469237722 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
6802025-01-17T08:20:29.367ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1803207345408324142 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
6812025-01-17T08:20:29.686ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:2::, width: 64 }
6822025-01-17T08:20:29.686ZINFOSledAgent (ServiceManager): Profile for oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService3'/> <propval type="astring" name="gateway" value='fd00:1122:3344:3::2'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:3::1'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/internal_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:3::1]:5353'/> <propval type="astring" name="dns_address" value='[fd00:1122:3344:3::1]:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
6832025-01-17T08:20:29.686ZINFOSledAgent (BootstrapAgentStartup): Sending prefix to ddmd for advertisement DdmAdminClient = [::1]:8000 file = clients/ddm-admin-client/src/lib.rs:86 prefix = Ipv6Net { addr: fd00:1122:3344:3::, width: 64 }
6842025-01-17T08:20:29.686ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
6852025-01-17T08:20:29.700ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a") failed: Property not found. retry in 72.479211ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
6862025-01-17T08:20:29.700ZINFOSledAgent (ServiceManager): Booting oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
6872025-01-17T08:20:29.781ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a") failed: Property not found. retry in 93.914625ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
6882025-01-17T08:20:29.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219") failed: Property not found. retry in 63.313831ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
6892025-01-17T08:20:29.826ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a") failed: Property not found. retry in 72.685916ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
6902025-01-17T08:20:29.858ZINFOSledAgent (ServiceManager): Ensuring address fd00:1122:3344:101::2 exists - OK file = sled-agent/src/services.rs:4301
6912025-01-17T08:20:29.858ZINFOSledAgent (ServiceManager): Ensuring there is a default route file = sled-agent/src/services.rs:4311 gateway = fd00:1122:3344:101::1
6922025-01-17T08:20:29.864ZINFOSledAgent (ServiceManager): Default route already exists file = sled-agent/src/services.rs:4325 gateway = fd00:1122:3344:101::1
6932025-01-17T08:20:29.864ZINFOSledAgent (ServiceManager): configuring dendrite service file = sled-agent/src/services.rs:4390
6942025-01-17T08:20:29.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a") failed: Property not found. retry in 266.617936ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
6952025-01-17T08:20:30.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219") failed: Property not found. retry in 110.849888ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
6962025-01-17T08:20:30.180ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a") failed: Property not found. retry in 132.058709ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
6972025-01-17T08:20:30.219ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a") failed: Property not found. retry in 425.552813ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
6982025-01-17T08:20:30.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219") failed: Property not found. retry in 253.775764ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
6992025-01-17T08:20:30.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a") failed: Property not found. retry in 263.673433ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
7002025-01-17T08:20:30.391ZINFOSledAgent (ServiceManager): refreshed dendrite service with new configuration file = sled-agent/src/services.rs:4456
7012025-01-17T08:20:30.391ZINFOSledAgent (ServiceManager): configuring lldp service file = sled-agent/src/services.rs:4483
7022025-01-17T08:20:30.443ZINFOSledAgent (ServiceManager): refreshed lldpd service with new configuration file = sled-agent/src/services.rs:4496
7032025-01-17T08:20:30.443ZINFOSledAgent (ServiceManager): configuring MGS service file = sled-agent/src/services.rs:4342
7042025-01-17T08:20:30.503ZINFOSledAgent (ServiceManager): refreshed MGS service with new configuration file = sled-agent/src/services.rs:4384
7052025-01-17T08:20:30.503ZINFOSledAgent (ServiceManager): configuring wicketd file = sled-agent/src/services.rs:4463 rack_subnet = fd00:1122:3344::
7062025-01-17T08:20:30.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219") failed: Property not found. retry in 428.275381ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
7072025-01-17T08:20:30.528ZINFOSledAgent (ServiceManager): refreshed wicketd service with new configuration file = sled-agent/src/services.rs:4474
7082025-01-17T08:20:30.528ZINFOSledAgent (ServiceManager): configuring mgd service file = sled-agent/src/services.rs:4516
7092025-01-17T08:20:30.609ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a") failed: Property not found. retry in 512.481822ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
7102025-01-17T08:20:30.609ZINFOSledAgent (ServiceManager): refreshed mgd service with new configuration file = sled-agent/src/services.rs:4548
7112025-01-17T08:20:30.609ZINFOSledAgent (ServiceManager): configuring mg-ddm service file = sled-agent/src/services.rs:4554
7122025-01-17T08:20:30.653ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a") failed: Property not found. retry in 568.091644ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
7132025-01-17T08:20:30.706ZINFOSledAgent (ServiceManager): refreshed mg-ddm service with new configuration file = sled-agent/src/services.rs:4595
7142025-01-17T08:20:30.706ZINFOSledAgent (ServiceManager): Determining physical location of our switch zone at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:370
7152025-01-17T08:20:30.742ZINFOSledAgent (ServiceManager): Initializing 1 Uplinks on Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:420
7162025-01-17T08:20:30.779ZINFOSledAgent (ServiceManager): Building Port Configuration file = sled-agent/src/bootstrap/early_networking.rs:717
7172025-01-17T08:20:30.779ZINFOSledAgent (ServiceManager): Checking dendrite uptime file = sled-agent/src/bootstrap/early_networking.rs:762
7182025-01-17T08:20:30.780ZINFOSledAgent (ServiceManager): Dendrite online file = sled-agent/src/bootstrap/early_networking.rs:765 uptime = 1
7192025-01-17T08:20:30.780ZINFOSledAgent (ServiceManager): Configuring default uplink on switch config = PortSettings {\n links: {\n "0": LinkSettings {\n addrs: [\n 10.151.2.174,\n ],\n params: LinkCreate {\n autoneg: false,\n fec: Some(\n None,\n ),\n kr: false,\n lane: Some(\n LinkId(\n 0,\n ),\n ),\n speed: Speed40G,\n tx_eq: None,\n },\n },\n },\n} file = sled-agent/src/bootstrap/early_networking.rs:444
7202025-01-17T08:20:30.817ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
7212025-01-17T08:20:30.871ZINFOSledAgent (StorageManager): Received DetectedRawDisksChanged { raw_disks: {}, tx: ... } file = sled-storage/src/manager.rs:607
7222025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7232025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-0" }
7242025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7252025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-M2", serial: "synthetic-serial-1" }
7262025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7272025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-0" }
7282025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7292025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-1" }
7302025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7312025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-2" }
7322025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7332025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-3" }
7342025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7352025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-4" }
7362025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7372025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-5" }
7382025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7392025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-6" }
7402025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7412025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-7" }
7422025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Removing disk file = sled-storage/src/resources.rs:529 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7432025-01-17T08:20:30.871ZINFOSledAgent (StorageResources): Not removing synthetic disk file = sled-storage/src/resources.rs:550 identity = DiskIdentity { vendor: "synthetic-vendor", model: "synthetic-model-U2", serial: "synthetic-serial-8" }
7442025-01-17T08:20:30.922ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
7452025-01-17T08:20:30.922ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
7462025-01-17T08:20:30.944ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219") failed: Property not found. retry in 746.298764ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
7472025-01-17T08:20:31.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a") failed: Property not found. retry in 890.448563ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
7482025-01-17T08:20:31.230ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a") failed: Property not found. retry in 979.00626ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
7492025-01-17T08:20:31.703ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219") failed: Property not found. retry in 1.102693127s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
7502025-01-17T08:20:32.031ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a") failed: Property not found. retry in 954.786695ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
7512025-01-17T08:20:32.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a") failed: Property not found. retry in 1.141706229s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
7522025-01-17T08:20:32.815ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219") failed: Property not found. retry in 998.667908ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
7532025-01-17T08:20:32.994ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a") failed: Property not found. retry in 1.385084089s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
7542025-01-17T08:20:33.369ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a") failed: Property not found. retry in 1.363473863s file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
7552025-01-17T08:20:33.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219") failed: Property not found. retry in 817.898847ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
7562025-01-17T08:20:34.389ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a") failed: Property not found. retry in 693.169281ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
7572025-01-17T08:20:34.649ZWARNSledAgent (ServiceManager): wait for service Some("oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219") failed: Property not found. retry in 759.686809ms file = illumos-utils/src/svc.rs:42 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
7582025-01-17T08:20:35.428ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_c6ef6b3a-8349-47f8-94bf-cee694328219
7592025-01-17T08:20:35.428ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_031d4967-d152-46af-88a4-eb487b5c2f7a
7602025-01-17T08:20:35.428ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_internal_dns_25507f08-a286-439f-b2a0-e23f9b5d951a
7612025-01-17T08:20:35.428ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7622025-01-17T08:20:35.428ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
7632025-01-17T08:20:35.429ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8464729 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:52411 req_id = 1a507012-6309-4387-b347-3e412e4209a8 response_code = 204 uri = /omicron-zones
7642025-01-17T08:20:35.431ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:1::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7652025-01-17T08:20:35.481ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:2::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7662025-01-17T08:20:36.656ZINFOSledAgent (RSS): Configuring DNS server dns_config_addr = [fd00:1122:3344:3::1]:5353 file = sled-agent/src/rack_setup/service.rs:658
7672025-01-17T08:20:36.705ZINFOSledAgent (RSS): Configured all DNS servers file = sled-agent/src/rack_setup/service.rs:694
7682025-01-17T08:20:36.705ZINFOSledAgent (RSS): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7692025-01-17T08:20:36.737ZINFOSledAgent (RSS): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7702025-01-17T08:20:36.738ZINFOSledAgent (RSS): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7712025-01-17T08:20:36.738ZINFOSledAgent (RSS): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7722025-01-17T08:20:36.767ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(3), zones: [OmicronZoneConfig { id: 031d4967-d152-46af-88a4-eb487b5c2f7a (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c6ef6b3a-8349-47f8-94bf-cee694328219 (service), filesystem_pool: Some(ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 25507f08-a286-439f-b2a0-e23f9b5d951a (service), filesystem_pool: Some(ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 47e826d6-de35-4b1e-a40d-44adb57109e2, kind: Service { id: 5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb }, name: Name("ntp-5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 230])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
7732025-01-17T08:20:36.767ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:36818
7742025-01-17T08:20:36.767ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7752025-01-17T08:20:36.767ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, responder: ... }
7762025-01-17T08:20:36.779ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7772025-01-17T08:20:36.779ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, responder: ... }
7782025-01-17T08:20:36.787ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
7792025-01-17T08:20:36.787ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
7802025-01-17T08:20:36.797ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7812025-01-17T08:20:36.797ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:177
7822025-01-17T08:20:36.797ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:177
7832025-01-17T08:20:36.798ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7842025-01-17T08:20:36.809ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
7852025-01-17T08:20:36.840ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
7862025-01-17T08:20:36.841ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
7872025-01-17T08:20:36.841ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
7882025-01-17T08:20:36.871ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte0", ip: 172.30.3.5, mac: MacAddr6([168, 64, 37, 255, 198, 230]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.3.1 } }) }
7892025-01-17T08:20:36.871ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = boundary_ntp
7902025-01-17T08:20:36.871ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:83
7912025-01-17T08:20:36.871ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:90
7922025-01-17T08:20:36.871ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.169 file = clients/dpd-client/src/lib.rs:118
7932025-01-17T08:20:36.872ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
7942025-01-17T08:20:36.894ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb file = illumos-utils/src/zone.rs:325
7952025-01-17T08:20:36.913ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb file = illumos-utils/src/zone.rs:363
7962025-01-17T08:20:37.531ZINFOSledAgent (ServiceManager): Profile for oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService4'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/chrony-setup"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="allow" value='fd00:1122:3344:100::/56'/> <propval type="boolean" name="boundary" value='true'/> <propval type="astring" name="boundary_pool" value='boundary-ntp.control-plane.oxide.internal'/> <propval type="astring" name="server" value='0.pool.ntp.org'/> </property_group> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="1.1.1.1" /> <value_node value="9.9.9.9" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/ntp"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte0'/> <propval type="astring" name="gateway" value='172.30.3.1'/> <propval type="astring" name="ip" value='172.30.3.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
7972025-01-17T08:20:37.531ZINFOSledAgent (ServiceManager): Booting oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
7982025-01-17T08:20:37.663ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 60.297563ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
7992025-01-17T08:20:37.733ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 124.873575ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8002025-01-17T08:20:37.872ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 233.036869ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8012025-01-17T08:20:38.114ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 267.552125ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8022025-01-17T08:20:38.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 410.688135ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8032025-01-17T08:20:38.811ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 855.864243ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8042025-01-17T08:20:39.369ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16418583778469237722 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8052025-01-17T08:20:39.369ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1803207345408324142 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8062025-01-17T08:20:39.676ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 1.011106628s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8072025-01-17T08:20:40.697ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 586.817504ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8082025-01-17T08:20:40.924ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8092025-01-17T08:20:40.924ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8102025-01-17T08:20:41.294ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 914.627154ms file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8112025-01-17T08:20:42.218ZWARNSledAgent (ServiceManager): wait for service Some("oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb") failed: Property not found. retry in 1.174992807s file = illumos-utils/src/svc.rs:42 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8122025-01-17T08:20:43.411ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb
8132025-01-17T08:20:43.411ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8142025-01-17T08:20:43.412ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
8152025-01-17T08:20:43.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6644718 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:36818 req_id = 198dad8b-95f0-4f22-aa80-850fee46da7c response_code = 204 uri = /omicron-zones
8162025-01-17T08:20:43.414ZINFOSledAgent (RSS): Waiting for rack time synchronization file = sled-agent/src/rack_setup/service.rs:735
8172025-01-17T08:20:43.444ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8182025-01-17T08:20:43.444ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37251
8192025-01-17T08:20:43.454ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8202025-01-17T08:20:43.454ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 9728 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:37251 req_id = 3058cd80-dff2-4b82-a745-4a312ddaf1a6 response_code = 500 uri = /timesync
8212025-01-17T08:20:43.457ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8222025-01-17T08:20:43.595ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8232025-01-17T08:20:43.595ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43505
8242025-01-17T08:20:44.758ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10254247330668741240 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8252025-01-17T08:20:45.107ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18204685083123278047 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8262025-01-17T08:20:45.431ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1691247851917813659 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8272025-01-17T08:20:47.603ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8282025-01-17T08:20:47.603ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 4008201 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43505 req_id = dca529df-57c6-49b4-a8af-929a8e4a7126 response_code = 500 uri = /timesync
8292025-01-17T08:20:47.606ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8302025-01-17T08:20:47.756ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8312025-01-17T08:20:47.756ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40861
8322025-01-17T08:20:47.764ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8332025-01-17T08:20:47.764ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 8524 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40861 req_id = eb1bc3fe-6d5d-45ea-a75b-14853de0b080 response_code = 500 uri = /timesync
8342025-01-17T08:20:47.767ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8352025-01-17T08:20:48.001ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8362025-01-17T08:20:48.001ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64027
8372025-01-17T08:20:48.009ZERROSledAgent (ServiceManager): chronyc command failed: Error running command in zone 'oxz_ntp_5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb': Command [/usr/bin/chronyc -c tracking] executed and failed with status: exit status: 1 stdout: 506 Cannot talk to daemon stderr: file = sled-agent/src/services.rs:3909
8382025-01-17T08:20:48.009ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = NTP zone not ready file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 7667 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64027 req_id = 38e00468-6913-4eb7-ab4e-62aa7607994f response_code = 500 uri = /timesync
8392025-01-17T08:20:48.012ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8402025-01-17T08:20:48.266ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8412025-01-17T08:20:48.266ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:56788
8422025-01-17T08:20:49.275ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1008185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:56788 req_id = ff50d71f-931e-424d-b80c-0ed136df8a20 response_code = 200 uri = /timesync
8432025-01-17T08:20:49.277ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8442025-01-17T08:20:49.277ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8452025-01-17T08:20:49.371ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16418583778469237722 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8462025-01-17T08:20:49.371ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1803207345408324142 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8472025-01-17T08:20:49.499ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8482025-01-17T08:20:49.499ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54409
8492025-01-17T08:20:49.508ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8582 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54409 req_id = 89de2eb3-a0e4-44ef-8c3c-9597312108b3 response_code = 200 uri = /timesync
8502025-01-17T08:20:49.510ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8512025-01-17T08:20:49.510ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8522025-01-17T08:20:49.768ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8532025-01-17T08:20:49.768ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53944
8542025-01-17T08:20:49.776ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8240 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53944 req_id = fdb8a1ef-2123-406c-8846-a8c89a24d2db response_code = 200 uri = /timesync
8552025-01-17T08:20:49.780ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8562025-01-17T08:20:49.780ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8572025-01-17T08:20:49.991ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8582025-01-17T08:20:49.991ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53357
8592025-01-17T08:20:49.998ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7540 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53357 req_id = fb1b309b-7f19-43d9-81d8-7bce31e7ab42 response_code = 200 uri = /timesync
8602025-01-17T08:20:50.002ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8612025-01-17T08:20:50.002ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8622025-01-17T08:20:50.536ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8632025-01-17T08:20:50.536ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43813
8642025-01-17T08:20:50.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7761 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43813 req_id = e9c66ef1-416c-4c24-a7cf-9a12a33609b1 response_code = 200 uri = /timesync
8652025-01-17T08:20:50.546ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8662025-01-17T08:20:50.546ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8672025-01-17T08:20:50.175ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8682025-01-17T08:20:50.175ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:63486
8692025-01-17T08:20:50.183ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8367 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:63486 req_id = 116b494e-e928-4279-bb4f-37be66265284 response_code = 200 uri = /timesync
8702025-01-17T08:20:50.185ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8712025-01-17T08:20:50.185ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8722025-01-17T08:20:50.248ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8732025-01-17T08:20:50.248ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8742025-01-17T08:20:51.097ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8752025-01-17T08:20:51.097ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:41956
8762025-01-17T08:20:51.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7865 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:41956 req_id = 1816c048-18cd-4a60-b5a8-3009bb2107e7 response_code = 200 uri = /timesync
8772025-01-17T08:20:51.109ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8782025-01-17T08:20:51.109ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8792025-01-17T08:20:51.714ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8802025-01-17T08:20:51.714ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49935
8812025-01-17T08:20:51.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8334 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49935 req_id = 5e8eb0b2-db53-4513-b73e-e4a07fc96942 response_code = 200 uri = /timesync
8822025-01-17T08:20:51.725ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: 0.0 } file = sled-agent/src/rack_setup/service.rs:743
8832025-01-17T08:20:51.725ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8842025-01-17T08:20:52.350ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8852025-01-17T08:20:52.351ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53636
8862025-01-17T08:20:52.359ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8419 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53636 req_id = 8938bf33-dda7-4924-92c3-93376c6a82a9 response_code = 200 uri = /timesync
8872025-01-17T08:20:52.361ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.270696908 } file = sled-agent/src/rack_setup/service.rs:743
8882025-01-17T08:20:52.361ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8892025-01-17T08:20:52.998ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8902025-01-17T08:20:52.998ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:53534
8912025-01-17T08:20:53.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8064 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:53534 req_id = e5e2aa23-3a5d-4e70-8fa1-34f8b68175c3 response_code = 200 uri = /timesync
8922025-01-17T08:20:53.008ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.266157657 } file = sled-agent/src/rack_setup/service.rs:743
8932025-01-17T08:20:53.008ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
8942025-01-17T08:20:53.284ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3369478950404690389 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8952025-01-17T08:20:53.284ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16005634818901351384 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
8962025-01-17T08:20:53.846ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
8972025-01-17T08:20:53.847ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:45680
8982025-01-17T08:20:53.856ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9134 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:45680 req_id = d4f41c2c-994e-4c79-b518-4459e1ae2f74 response_code = 200 uri = /timesync
8992025-01-17T08:20:53.858ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.261032552 } file = sled-agent/src/rack_setup/service.rs:743
9002025-01-17T08:20:53.858ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9012025-01-17T08:20:54.186ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 133.522156ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9022025-01-17T08:20:54.627ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10254247330668741240 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9032025-01-17T08:20:54.973ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18204685083123278047 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9042025-01-17T08:20:55.296ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1691247851917813659 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9052025-01-17T08:20:55.340ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9062025-01-17T08:20:55.340ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:49541
9072025-01-17T08:20:55.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9052 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:49541 req_id = ee74ab42-ec05-46cd-a280-2cf3482383cb response_code = 200 uri = /timesync
9082025-01-17T08:20:55.352ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 0, ip_addr: ::, stratum: 0, ref_time: 0.0, correction: -0.25648576 } file = sled-agent/src/rack_setup/service.rs:743
9092025-01-17T08:20:55.352ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9102025-01-17T08:20:56.888ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9112025-01-17T08:20:56.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:54795
9122025-01-17T08:20:56.896ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8396 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:54795 req_id = 1f7dfd10-a8cc-410a-8c40-7cc0869672c8 response_code = 200 uri = /timesync
9132025-01-17T08:20:56.900ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102056.0725002, correction: -0.252200425 } file = sled-agent/src/rack_setup/service.rs:743
9142025-01-17T08:20:56.900ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9152025-01-17T08:20:57.987ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9162025-01-17T08:20:57.987ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59046
9172025-01-17T08:20:57.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7878 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59046 req_id = d0ebb969-6fde-4a60-ba7b-31f82ead2078 response_code = 200 uri = /timesync
9182025-01-17T08:20:57.997ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102057.3024087, correction: -0.249135613 } file = sled-agent/src/rack_setup/service.rs:743
9192025-01-17T08:20:57.997ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9202025-01-17T08:20:59.226ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16418583778469237722 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9212025-01-17T08:20:59.226ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1803207345408324142 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9222025-01-17T08:21:00.252ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46048
9232025-01-17T08:21:00.252ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46048 req_id = fd4e0913-f47b-4fd4-9d3c-b83699aa0614 response_code = 200 uri = /baseboard
9242025-01-17T08:21:00.330ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9252025-01-17T08:21:00.330ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:64901
9262025-01-17T08:21:00.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9245 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:64901 req_id = 93064387-cf65-491b-8ea0-312f95d3f21a response_code = 200 uri = /timesync
9272025-01-17T08:21:00.342ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102059.0718298, correction: -0.241966739 } file = sled-agent/src/rack_setup/service.rs:743
9282025-01-17T08:21:00.342ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9292025-01-17T08:21:00.778ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9302025-01-17T08:21:00.778ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9312025-01-17T08:21:03.259ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3369478950404690389 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9322025-01-17T08:21:03.259ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16005634818901351384 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9332025-01-17T08:21:04.331ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9342025-01-17T08:21:04.331ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:60341
9352025-01-17T08:21:04.340ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9051 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:60341 req_id = ce4a0945-e151-4e82-89b9-946a94abc44b response_code = 200 uri = /timesync
9362025-01-17T08:21:04.343ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102063.080802, correction: -0.230953544 } file = sled-agent/src/rack_setup/service.rs:743
9372025-01-17T08:21:04.343ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9382025-01-17T08:21:04.602ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10254247330668741240 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9392025-01-17T08:21:04.947ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18204685083123278047 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9402025-01-17T08:21:05.270ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1691247851917813659 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9412025-01-17T08:21:09.025ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9422025-01-17T08:21:09.025ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57611
9432025-01-17T08:21:09.034ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8812 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:57611 req_id = 0b116a9d-50c6-4553-841f-28ec38debf92 response_code = 200 uri = /timesync
9442025-01-17T08:21:09.036ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102067.4325292, correction: -0.217866138 } file = sled-agent/src/rack_setup/service.rs:743
9452025-01-17T08:21:09.036ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9462025-01-17T08:21:09.201ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16418583778469237722 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9472025-01-17T08:21:09.201ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1803207345408324142 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9482025-01-17T08:21:09.313ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 505.213552ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9492025-01-17T08:21:10.753ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9502025-01-17T08:21:10.753ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9512025-01-17T08:21:11.204ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9522025-01-17T08:21:11.204ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61377
9532025-01-17T08:21:11.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8699 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61377 req_id = 86daadc2-5cea-420e-8de5-06ba5a30e649 response_code = 200 uri = /timesync
9542025-01-17T08:21:11.215ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102067.4325292, correction: -0.211948469 } file = sled-agent/src/rack_setup/service.rs:743
9552025-01-17T08:21:11.215ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9562025-01-17T08:21:13.234ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3369478950404690389 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9572025-01-17T08:21:13.234ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16005634818901351384 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9582025-01-17T08:21:14.576ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10254247330668741240 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9592025-01-17T08:21:14.922ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18204685083123278047 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9602025-01-17T08:21:15.243ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1691247851917813659 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9612025-01-17T08:21:17.527ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9622025-01-17T08:21:17.527ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59879
9632025-01-17T08:21:17.536ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8906 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59879 req_id = d7af474f-f8c7-45ee-9717-17b0123cc638 response_code = 200 uri = /timesync
9642025-01-17T08:21:17.538ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102067.4325292, correction: -0.194776684 } file = sled-agent/src/rack_setup/service.rs:743
9652025-01-17T08:21:17.538ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9662025-01-17T08:21:19.176ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16418583778469237722 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9672025-01-17T08:21:19.176ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1803207345408324142 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9682025-01-17T08:21:20.510ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9692025-01-17T08:21:20.510ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:59097
9702025-01-17T08:21:20.519ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:59097 req_id = b202fb20-936d-4c93-b359-e26495dd4dae response_code = 200 uri = /timesync
9712025-01-17T08:21:20.522ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102067.4325292, correction: -0.186676234 } file = sled-agent/src/rack_setup/service.rs:743
9722025-01-17T08:21:20.522ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9732025-01-17T08:21:20.729ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9742025-01-17T08:21:20.729ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9752025-01-17T08:21:23.209ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3369478950404690389 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9762025-01-17T08:21:23.209ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16005634818901351384 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9772025-01-17T08:21:24.552ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10254247330668741240 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9782025-01-17T08:21:24.811ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 572.849865ms error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9792025-01-17T08:21:24.897ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18204685083123278047 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9802025-01-17T08:21:25.218ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1691247851917813659 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9812025-01-17T08:21:28.766ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9822025-01-17T08:21:28.766ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:51085
9832025-01-17T08:21:28.775ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8659 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:51085 req_id = 287cd47b-b6bb-449b-a94b-5d1481b1619e response_code = 200 uri = /timesync
9842025-01-17T08:21:28.778ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102084.4299235, correction: -0.164398879 } file = sled-agent/src/rack_setup/service.rs:743
9852025-01-17T08:21:28.778ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9862025-01-17T08:21:29.151ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16418583778469237722 reason = Duration(60s) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9872025-01-17T08:21:29.151ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1803207345408324142 reason = Duration(60s) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9882025-01-17T08:21:30.205ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:44047
9892025-01-17T08:21:30.205ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:44047 req_id = f7b7e17c-4906-4e52-b3d6-6277dd257fde response_code = 200 uri = /baseboard
9902025-01-17T08:21:30.704ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9912025-01-17T08:21:30.704ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9922025-01-17T08:21:33.184ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3369478950404690389 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9932025-01-17T08:21:33.184ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16005634818901351384 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
9942025-01-17T08:21:33.863ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
9952025-01-17T08:21:33.864ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:46049
9962025-01-17T08:21:33.872ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8559 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:46049 req_id = 29c53336-c121-45ea-97d1-d9d4f31ff52a response_code = 200 uri = /timesync
9972025-01-17T08:21:33.876ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 395716850, ip_addr: 23.150.40.242, stratum: 3, ref_time: 1737102084.4299235, correction: -0.150555924 } file = sled-agent/src/rack_setup/service.rs:743
9982025-01-17T08:21:33.876ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
9992025-01-17T08:21:34.526ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 10254247330668741240 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10002025-01-17T08:21:34.871ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 18204685083123278047 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10012025-01-17T08:21:35.193ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 1691247851917813659 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10022025-01-17T08:21:39.162ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10032025-01-17T08:21:39.162ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:55029
10042025-01-17T08:21:39.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9795 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:55029 req_id = e28f76dc-c558-4e57-9832-5226506692ca response_code = 200 uri = /timesync
10052025-01-17T08:21:39.175ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1737102097.5965884, correction: -0.134165823 } file = sled-agent/src/rack_setup/service.rs:743
10062025-01-17T08:21:39.175ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10072025-01-17T08:21:40.377ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 1.47846417s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10082025-01-17T08:21:40.679ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10092025-01-17T08:21:40.679ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10102025-01-17T08:21:43.159ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 3369478950404690389 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10112025-01-17T08:21:43.159ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 16005634818901351384 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10122025-01-17T08:21:44.502ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 10254247330668741240 reason = Duration(60s) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10132025-01-17T08:21:44.844ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 18204685083123278047 reason = Duration(60s) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10142025-01-17T08:21:45.167ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 1691247851917813659 reason = Duration(60s) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10152025-01-17T08:21:50.209ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10162025-01-17T08:21:50.209ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:61407
10172025-01-17T08:21:50.218ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 8701 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:61407 req_id = 9a901d53-edfb-41d6-b15d-e1f112aa7708 response_code = 200 uri = /timesync
10182025-01-17T08:21:50.220ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1737102109.665603, correction: -0.104241662 } file = sled-agent/src/rack_setup/service.rs:743
10192025-01-17T08:21:50.220ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10202025-01-17T08:21:50.655ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10212025-01-17T08:21:50.655ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10222025-01-17T08:21:53.134ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 3369478950404690389 reason = Duration(60s) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10232025-01-17T08:21:53.134ZERROSledAgent (kstat-sampler-worker): expiring kstat after too many failures error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:485 id = 16005634818901351384 reason = Duration(60s) sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10242025-01-17T08:21:56.846ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 4.690177809s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10252025-01-17T08:22:00.159ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:40210
10262025-01-17T08:22:00.159ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:40210 req_id = f27ef80e-e1af-4e4d-ae40-718011c9b73d response_code = 200 uri = /baseboard
10272025-01-17T08:22:00.629ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10282025-01-17T08:22:00.630ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10292025-01-17T08:22:06.298ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10302025-01-17T08:22:06.299ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:43771
10312025-01-17T08:22:06.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 9288 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:43771 req_id = b487c18e-2860-4a20-a7bd-8ff691ce230b response_code = 200 uri = /timesync
10322025-01-17T08:22:06.311ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: false, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1737102125.7532496, correction: -0.060580425 } file = sled-agent/src/rack_setup/service.rs:743
10332025-01-17T08:22:06.311ZWARNSledAgent (RSS): Time is not yet synchronized error = "Time is synchronized on 0/1 sleds" file = sled-agent/src/rack_setup/service.rs:765
10342025-01-17T08:22:10.604ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10352025-01-17T08:22:10.604ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10362025-01-17T08:22:16.518ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 11.233779482s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10372025-01-17T08:22:20.579ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 4046404255840485765 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10382025-01-17T08:22:20.579ZERROSledAgent (kstat-sampler-worker): failed to sample kstat target, requeueing error = NoSuchKstat file = oximeter/instruments/src/kstat/sampler.rs:496 id = 15427499763254598935 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10392025-01-17T08:22:28.014ZINFOSledAgent (RSS): Checking time synchronization for [fd00:1122:3344:101::1]:12345... file = sled-agent/src/rack_setup/service.rs:715
10402025-01-17T08:22:28.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:40336
10412025-01-17T08:22:28.035ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 20586 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::1]:40336 req_id = 6d5a41db-db86-4eae-a6b7-1dc0f318e754 response_code = 200 uri = /timesync
10422025-01-17T08:22:28.035ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-17T08:21:29.151877903Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1803207345408324142 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10432025-01-17T08:22:28.036ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-17T08:21:29.151338899Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16418583778469237722 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10442025-01-17T08:22:28.037ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-17T08:21:44.502001212Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 10254247330668741240 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10452025-01-17T08:22:28.037ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-17T08:21:45.167365660Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 1691247851917813659 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10462025-01-17T08:22:28.037ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-17T08:21:44.844869442Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 18204685083123278047 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10472025-01-17T08:22:28.037ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-17T08:21:53.134300315Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 3369478950404690389 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10482025-01-17T08:22:28.038ZWARNSledAgent (kstat-sampler-worker): replacing expired kstat target error = NoSuchKstat expiration_reason = Duration(60s) expired_at = 2025-01-17T08:21:53.134679288Z file = oximeter/instruments/src/kstat/sampler.rs:1028 id = 16005634818901351384 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
10492025-01-17T08:22:28.039ZINFOSledAgent (RSS): Timesync for [fd00:1122:3344:101::1]:12345 TimeSync { sync: true, ref_id: 1760181621, ip_addr: 104.234.61.117, stratum: 3, ref_time: 1737102145.3585963, correction: -0.001575277 } file = sled-agent/src/rack_setup/service.rs:743
10502025-01-17T08:22:28.039ZINFOSledAgent (RSS): Finished setting up Internal DNS and NTP file = sled-agent/src/rack_setup/service.rs:1392
10512025-01-17T08:22:28.070ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(4), zones: [OmicronZoneConfig { id: 031d4967-d152-46af-88a4-eb487b5c2f7a (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c6ef6b3a-8349-47f8-94bf-cee694328219 (service), filesystem_pool: Some(ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 25507f08-a286-439f-b2a0-e23f9b5d951a (service), filesystem_pool: Some(ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 47e826d6-de35-4b1e-a40d-44adb57109e2, kind: Service { id: 5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb }, name: Name("ntp-5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 230])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: f0393853-9780-439a-94bc-ed7b9817f706 (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } } } }, OmicronZoneConfig { id: b5adee1c-0e6a-4989-80e0-ab8705b88175 (service), filesystem_pool: Some(ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External } } } }, OmicronZoneConfig { id: d60e582c-9274-49df-bfdc-efd5dfb568e3 (service), filesystem_pool: Some(ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 599d0e15-2ca6-4963-85fb-a0bf66c0102c (service), filesystem_pool: Some(ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External } } } }, OmicronZoneConfig { id: bb3d858c-c124-4aa1-8cad-3f764ec04d1b (service), filesystem_pool: Some(ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
10522025-01-17T08:22:28.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:57286
10532025-01-17T08:22:28.070ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10542025-01-17T08:22:28.070ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, responder: ... }
10552025-01-17T08:22:28.082ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10562025-01-17T08:22:28.082ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, responder: ... }
10572025-01-17T08:22:28.091ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
10582025-01-17T08:22:28.091ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
10592025-01-17T08:22:28.100ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10602025-01-17T08:22:28.100ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Cockroach }, responder: ... }
10612025-01-17T08:22:28.110ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10622025-01-17T08:22:28.110ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Cockroach }, responder: ... }
10632025-01-17T08:22:28.119ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10642025-01-17T08:22:28.119ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
10652025-01-17T08:22:28.128ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10662025-01-17T08:22:28.128ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Cockroach }, responder: ... }
10672025-01-17T08:22:28.138ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
10682025-01-17T08:22:28.138ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Cockroach }, responder: ... }
10692025-01-17T08:22:28.147ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10702025-01-17T08:22:28.147ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:177
10712025-01-17T08:22:28.147ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:177
10722025-01-17T08:22:28.147ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10732025-01-17T08:22:28.229ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10742025-01-17T08:22:28.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10752025-01-17T08:22:28.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10762025-01-17T08:22:28.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10772025-01-17T08:22:28.230ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
10782025-01-17T08:22:28.321ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175 file = illumos-utils/src/zone.rs:325
10792025-01-17T08:22:28.325ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c file = illumos-utils/src/zone.rs:325
10802025-01-17T08:22:28.330ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b file = illumos-utils/src/zone.rs:325
10812025-01-17T08:22:28.334ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706 file = illumos-utils/src/zone.rs:325
10822025-01-17T08:22:28.339ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3 file = illumos-utils/src/zone.rs:325
10832025-01-17T08:22:28.343ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175 file = illumos-utils/src/zone.rs:363
10842025-01-17T08:22:28.348ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c file = illumos-utils/src/zone.rs:363
10852025-01-17T08:22:28.352ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b file = illumos-utils/src/zone.rs:363
10862025-01-17T08:22:28.357ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706 file = illumos-utils/src/zone.rs:363
10872025-01-17T08:22:28.361ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3 file = illumos-utils/src/zone.rs:363
10882025-01-17T08:22:30.114ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:62796
10892025-01-17T08:22:30.114ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:62796 req_id = cc536000-1f4b-4e75-999a-e7691fb2a48d response_code = 200 uri = /baseboard
10902025-01-17T08:22:31.885ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService8'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::3'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='f0393853-9780-439a-94bc-ed7b9817f706'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::3]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::3]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10912025-01-17T08:22:31.886ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
10922025-01-17T08:22:31.989ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService9'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='d60e582c-9274-49df-bfdc-efd5dfb568e3'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::5]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::5]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10932025-01-17T08:22:31.989ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
10942025-01-17T08:22:32.045ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService6'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='599d0e15-2ca6-4963-85fb-a0bf66c0102c'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::6]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::6]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10952025-01-17T08:22:32.045ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
10962025-01-17T08:22:32.066ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService5'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::4'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='b5adee1c-0e6a-4989-80e0-ab8705b88175'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::4]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::4]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10972025-01-17T08:22:32.067ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
10982025-01-17T08:22:32.155ZINFOSledAgent (ServiceManager): Profile for oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService7'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/cockroachdb"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="oxide/cockroach-admin"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="zone_id" value='bb3d858c-c124-4aa1-8cad-3f764ec04d1b'/> <propval type="astring" name="cockroach_address" value='[fd00:1122:3344:101::7]:32221'/> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::7]:32222'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
10992025-01-17T08:22:32.155ZINFOSledAgent (ServiceManager): Booting oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11002025-01-17T08:22:32.290ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 58.235757ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11012025-01-17T08:22:32.348ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 32.970142ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11022025-01-17T08:22:32.380ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 29.579597ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11032025-01-17T08:22:32.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 32.65054ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11042025-01-17T08:22:32.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 57.883997ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11052025-01-17T08:22:32.705ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 74.473606ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11062025-01-17T08:22:32.727ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 80.524278ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11072025-01-17T08:22:32.739ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 137.96518ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11082025-01-17T08:22:32.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 45.047487ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11092025-01-17T08:22:32.762ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 160.981444ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11102025-01-17T08:22:32.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 142.534354ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11112025-01-17T08:22:32.814ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 53.889664ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11122025-01-17T08:22:32.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 256.853209ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11132025-01-17T08:22:32.890ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 224.511069ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11142025-01-17T08:22:32.908ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 102.494302ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11152025-01-17T08:22:32.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 450.823856ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11162025-01-17T08:22:32.955ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 332.061973ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11172025-01-17T08:22:33.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 297.776727ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11182025-01-17T08:22:33.094ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 459.264837ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11192025-01-17T08:22:33.138ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 208.537741ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11202025-01-17T08:22:33.300ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 833.334152ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11212025-01-17T08:22:33.334ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 754.927188ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11222025-01-17T08:22:33.351ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 503.009348ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11232025-01-17T08:22:33.424ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 994.793431ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11242025-01-17T08:22:33.566ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 692.319263ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11252025-01-17T08:22:33.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 657.485096ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11262025-01-17T08:22:34.100ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 1.276374016s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11272025-01-17T08:22:34.142ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 1.243351109s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11282025-01-17T08:22:34.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 1.038317851s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11292025-01-17T08:22:34.428ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 1.248223576s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11302025-01-17T08:22:34.535ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 1.175266866s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11312025-01-17T08:22:35.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 1.326342224s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11322025-01-17T08:22:35.386ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 523.868601ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11332025-01-17T08:22:35.394ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 1.16627437s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11342025-01-17T08:22:35.684ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 1.182812278s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11352025-01-17T08:22:35.720ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 1.29943554s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11362025-01-17T08:22:35.919ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 767.797278ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11372025-01-17T08:22:36.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 974.878836ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11382025-01-17T08:22:36.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 839.283824ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11392025-01-17T08:22:36.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 1.424076458s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11402025-01-17T08:22:36.875ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 711.107628ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11412025-01-17T08:22:37.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 1.022561839s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11422025-01-17T08:22:37.504ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 965.028191ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11432025-01-17T08:22:37.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 754.254965ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11442025-01-17T08:22:37.595ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 780.206783ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11452025-01-17T08:22:38.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 1.286034477s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11462025-01-17T08:22:38.129ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 517.683619ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11472025-01-17T08:22:38.318ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 982.771332ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11482025-01-17T08:22:38.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 1.03756165s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11492025-01-17T08:22:38.477ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 603.741922ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11502025-01-17T08:22:38.655ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 1.468838156s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11512025-01-17T08:22:39.092ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 600.638138ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11522025-01-17T08:22:39.312ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 636.935851ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11532025-01-17T08:22:39.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 632.079103ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11542025-01-17T08:22:39.430ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 1.24147545s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11552025-01-17T08:22:39.702ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 563.223193ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11562025-01-17T08:22:39.959ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 1.022283681s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11572025-01-17T08:22:39.999ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 1.134307483s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11582025-01-17T08:22:40.135ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 1.336278981s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11592025-01-17T08:22:40.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 1.431075942s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11602025-01-17T08:22:40.681ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 1.0842473s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11612025-01-17T08:22:40.992ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 1.160416945s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11622025-01-17T08:22:41.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 971.723552ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11632025-01-17T08:22:41.482ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 1.028796655s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11642025-01-17T08:22:41.715ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 508.705822ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11652025-01-17T08:22:41.775ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 663.141385ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11662025-01-17T08:22:42.125ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 611.110372ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11672025-01-17T08:22:42.162ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 518.644276ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11682025-01-17T08:22:42.233ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 1.127268985s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11692025-01-17T08:22:42.448ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706") failed: Property not found. retry in 1.36328705s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11702025-01-17T08:22:42.520ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c") failed: Property not found. retry in 1.480075507s file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11712025-01-17T08:22:42.689ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 808.510159ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11722025-01-17T08:22:42.745ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 979.269726ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11732025-01-17T08:22:42.756ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 22.75936354s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
11742025-01-17T08:22:43.371ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175") failed: Property not found. retry in 676.742996ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11752025-01-17T08:22:43.507ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3") failed: Property not found. retry in 641.21087ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11762025-01-17T08:22:43.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b") failed: Property not found. retry in 940.772901ms file = illumos-utils/src/svc.rs:42 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11772025-01-17T08:22:44.697ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_b5adee1c-0e6a-4989-80e0-ab8705b88175
11782025-01-17T08:22:44.697ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c
11792025-01-17T08:22:44.697ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_bb3d858c-c124-4aa1-8cad-3f764ec04d1b
11802025-01-17T08:22:44.697ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_f0393853-9780-439a-94bc-ed7b9817f706
11812025-01-17T08:22:44.697ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_cockroachdb_d60e582c-9274-49df-bfdc-efd5dfb568e3
11822025-01-17T08:22:44.697ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11832025-01-17T08:22:44.698ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
11842025-01-17T08:22:44.698ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 16629247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:57286 req_id = 24a6ae4c-083b-4b11-b532-2379f9ad58ae response_code = 204 uri = /omicron-zones
11852025-01-17T08:22:44.732ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:37385
11862025-01-17T08:22:44.766ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 33238 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = baf75d00-a2a7-4375-a049-c492540eac13 response_code = 500 uri = /cockroachdb
11872025-01-17T08:22:44.766ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "baf75d00-a2a7-4375-a049-c492540eac13", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "baf75d00-a2a7-4375-a049-c492540eac13" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 117.25476ms
11882025-01-17T08:22:44.912ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28035 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = 353f30da-5469-4f2d-8235-3ae38e4e8ce3 response_code = 500 uri = /cockroachdb
11892025-01-17T08:22:44.912ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "353f30da-5469-4f2d-8235-3ae38e4e8ce3", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "353f30da-5469-4f2d-8235-3ae38e4e8ce3" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 164.806522ms
11902025-01-17T08:22:45.107ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28083 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = c25e6e44-f846-47c6-b459-44ee26f60347 response_code = 500 uri = /cockroachdb
11912025-01-17T08:22:45.107ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "c25e6e44-f846-47c6-b459-44ee26f60347", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "c25e6e44-f846-47c6-b459-44ee26f60347" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 83.49158ms
11922025-01-17T08:22:45.218ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25993 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = 9c85c142-8e6a-4af5-a705-2edde607fc14 response_code = 500 uri = /cockroachdb
11932025-01-17T08:22:45.218ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "9c85c142-8e6a-4af5-a705-2edde607fc14", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "9c85c142-8e6a-4af5-a705-2edde607fc14" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 167.569511ms
11942025-01-17T08:22:45.413ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26807 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = 79a86771-69da-4c3a-ad4b-a865da5377a6 response_code = 500 uri = /cockroachdb
11952025-01-17T08:22:45.414ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "79a86771-69da-4c3a-ad4b-a865da5377a6", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "79a86771-69da-4c3a-ad4b-a865da5377a6" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 195.957294ms
11962025-01-17T08:22:45.636ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = 2f0bd08e-41f0-40bc-b1e3-433e1b9d1d90 response_code = 500 uri = /cockroachdb
11972025-01-17T08:22:45.636ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "2f0bd08e-41f0-40bc-b1e3-433e1b9d1d90", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:44 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "2f0bd08e-41f0-40bc-b1e3-433e1b9d1d90" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 295.864693ms
11982025-01-17T08:22:45.959ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 25287 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = 0fbde4b7-fc64-4cab-8ad8-55c703ea975a response_code = 500 uri = /cockroachdb
11992025-01-17T08:22:45.959ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "0fbde4b7-fc64-4cab-8ad8-55c703ea975a", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "0fbde4b7-fc64-4cab-8ad8-55c703ea975a" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 401.380546ms
12002025-01-17T08:22:46.389ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 28049 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = 987a4164-82ba-44ca-bd1e-f11204879086 response_code = 500 uri = /cockroachdb
12012025-01-17T08:22:46.390ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "987a4164-82ba-44ca-bd1e-f11204879086", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:45 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "987a4164-82ba-44ca-bd1e-f11204879086" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 222.218115ms
12022025-01-17T08:22:46.639ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26132 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = e0afca73-efaa-46a7-883c-38d9ef737c6c response_code = 500 uri = /cockroachdb
12032025-01-17T08:22:46.639ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "e0afca73-efaa-46a7-883c-38d9ef737c6c", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "e0afca73-efaa-46a7-883c-38d9ef737c6c" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 557.875237ms
12042025-01-17T08:22:47.225ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 26162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = 3862f072-051a-482f-afec-64f5d832d2e6 response_code = 500 uri = /cockroachdb
12052025-01-17T08:22:47.225ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "3862f072-051a-482f-afec-64f5d832d2e6", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "3862f072-051a-482f-afec-64f5d832d2e6" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 264.883871ms
12062025-01-17T08:22:47.514ZINFOSledAgent (dropshot (SledAgent)): request completed error_message_external = Internal Server Error error_message_internal = Failed to get address: Failed to get address for name oxControlService6/omicron6 in oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c: Zone execution error: Command [/usr/sbin/zlogin oxz_cockroachdb_599d0e15-2ca6-4963-85fb-a0bf66c0102c /usr/sbin/ipadm show-addr -p -o ADDR oxControlService6/omicron6] executed and failed with status: exit status: 1 stdout: \n stderr: ipadm: Could not get address: Object not found file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:855 latency_us = 23927 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = 7e39fbc7-77fd-4972-895f-a01a66ffb4e3 response_code = 500 uri = /cockroachdb
12072025-01-17T08:22:47.514ZWARNSledAgent (RSS): Failed to initialize CockroachDB error = Error Response: status: 500 Internal Server Error; headers: {"content-type": "application/json", "x-request-id": "7e39fbc7-77fd-4972-895f-a01a66ffb4e3", "content-length": "124", "date": "Fri, 17 Jan 2025 08:22:46 GMT"}; value: Error { error_code: Some("Internal"), message: "Internal Server Error", request_id: "7e39fbc7-77fd-4972-895f-a01a66ffb4e3" } file = sled-agent/src/rack_setup/service.rs:1158 retry_after = 375.427979ms
12082025-01-17T08:22:47.923ZINFOSledAgent (ServiceManager): Initializing CRDB Cluster - sending request to [fd00:1122:3344:101::6]:32221 file = sled-agent/src/services.rs:3752
12092025-01-17T08:23:04.756ZINFOSledAgent (ServiceManager): Formatting CRDB file = sled-agent/src/services.rs:3770
12102025-01-17T08:23:10.988ZINFOSledAgent (ServiceManager): Formatting CRDB - Completed file = sled-agent/src/services.rs:3793
12112025-01-17T08:23:10.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 23099258 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::1]:37385 req_id = cb75f976-5bae-46eb-b248-0645b8e28eb2 response_code = 204 uri = /cockroachdb
12122025-01-17T08:23:10.993ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48374
12132025-01-17T08:23:10.995ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 838 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48374 req_id = 731a9296-7b30-44f8-b4f4-8c58d0bee77d response_code = 200 uri = /baseboard
12142025-01-17T08:23:11.042ZINFOSledAgent (RSS): attempting to set up sled's Omicron zones: OmicronZonesConfig { generation: Generation(5), zones: [OmicronZoneConfig { id: 031d4967-d152-46af-88a4-eb487b5c2f7a (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } }, http_address: [fd00:1122:3344:1::1]:5353, dns_address: [fd00:1122:3344:1::1]:53, gz_address: fd00:1122:3344:1::2, gz_address_index: 0 } }, OmicronZoneConfig { id: c6ef6b3a-8349-47f8-94bf-cee694328219 (service), filesystem_pool: Some(ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External } }, http_address: [fd00:1122:3344:2::1]:5353, dns_address: [fd00:1122:3344:2::1]:53, gz_address: fd00:1122:3344:2::2, gz_address_index: 1 } }, OmicronZoneConfig { id: 25507f08-a286-439f-b2a0-e23f9b5d951a (service), filesystem_pool: Some(ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }), zone_type: InternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External } }, http_address: [fd00:1122:3344:3::1]:5353, dns_address: [fd00:1122:3344:3::1]:53, gz_address: fd00:1122:3344:3::2, gz_address_index: 2 } }, OmicronZoneConfig { id: 5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: BoundaryNtp { address: [fd00:1122:3344:101::1b]:123, ntp_servers: ["0.pool.ntp.org"], dns_servers: [1.1.1.1, 9.9.9.9], domain: None, nic: NetworkInterface { id: 47e826d6-de35-4b1e-a40d-44adb57109e2, kind: Service { id: 5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb }, name: Name("ntp-5f5bc9bc-b0d4-4ffe-a6ec-955a40f66ebb"), ip: 172.30.3.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 230])), subnet: V4(Ipv4Net { addr: 172.30.3.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, snat_cfg: SourceNatConfig { ip: 10.151.2.169, first_port: 0, last_port: 16383 } } }, OmicronZoneConfig { id: f0393853-9780-439a-94bc-ed7b9817f706 (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::3]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } } } }, OmicronZoneConfig { id: b5adee1c-0e6a-4989-80e0-ab8705b88175 (service), filesystem_pool: Some(ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::4]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External } } } }, OmicronZoneConfig { id: d60e582c-9274-49df-bfdc-efd5dfb568e3 (service), filesystem_pool: Some(ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::5]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 599d0e15-2ca6-4963-85fb-a0bf66c0102c (service), filesystem_pool: Some(ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::6]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External } } } }, OmicronZoneConfig { id: bb3d858c-c124-4aa1-8cad-3f764ec04d1b (service), filesystem_pool: Some(ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }), zone_type: CockroachDb { address: [fd00:1122:3344:101::7]:32221, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External } } } }, OmicronZoneConfig { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } }, http_address: [fd00:1122:3344:101::8]:5353, dns_address: 10.151.2.164:53, nic: NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d (service), filesystem_pool: Some(ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }), zone_type: ExternalDns { dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External } }, http_address: [fd00:1122:3344:101::9]:5353, dns_address: 10.151.2.165:53, nic: NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] } } }, OmicronZoneConfig { id: b72586ef-ab31-4002-9c99-4f4040a5f525 (service), filesystem_pool: Some(ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::a]:12221, external_ip: 10.151.2.166, nic: NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd (service), filesystem_pool: Some(ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::b]:12221, external_ip: 10.151.2.167, nic: NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: c34158a3-fac5-4036-bee4-fac8eb171c5f (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: Nexus { internal_address: [fd00:1122:3344:101::c]:12221, external_ip: 10.151.2.168, nic: NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, external_tls: true, external_dns_servers: [1.1.1.1, 9.9.9.9] } }, OmicronZoneConfig { id: 0cc45a67-34ed-4014-ae46-f6e108da31b8 (service), filesystem_pool: Some(ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }), zone_type: Oximeter { address: [fd00:1122:3344:101::d]:12223 } }, OmicronZoneConfig { id: f862f3d3-2aa5-4e09-b5d5-80d66f1fee46 (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: Clickhouse { address: [fd00:1122:3344:101::e]:8123, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } } } }, OmicronZoneConfig { id: 74a4affd-587b-4477-baec-99fd2f4ce951 (service), filesystem_pool: Some(ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::f]:17000 } }, OmicronZoneConfig { id: 48bbb14c-7d9a-4043-814c-748e60d2d426 (service), filesystem_pool: Some(ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::10]:17000 } }, OmicronZoneConfig { id: 44709bbb-3699-4a47-b96b-24dd8f2f9078 (service), filesystem_pool: Some(ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }), zone_type: CruciblePantry { address: [fd00:1122:3344:101::11]:17000 } }, OmicronZoneConfig { id: dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a (service), filesystem_pool: Some(ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::12]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External } } } }, OmicronZoneConfig { id: c7d58af7-8c60-493b-a5fd-9efe25f43b63 (service), filesystem_pool: Some(ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::13]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External } } } }, OmicronZoneConfig { id: c991210e-8bfe-49d4-9557-11fb49b643d5 (service), filesystem_pool: Some(ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::14]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External } } } }, OmicronZoneConfig { id: 85d89493-0cfa-47c2-80e7-63ba29ed0c11 (service), filesystem_pool: Some(ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::15]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External } } } }, OmicronZoneConfig { id: c2bd9e35-0da2-4024-9de4-455197bdef32 (service), filesystem_pool: Some(ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::16]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External } } } }, OmicronZoneConfig { id: 69391479-0b2e-48ec-af22-d5eebf5902c3 (service), filesystem_pool: Some(ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::17]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External } } } }, OmicronZoneConfig { id: 2ea3a990-cf29-4ece-a3c3-c643a80e29bb (service), filesystem_pool: Some(ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::18]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External } } } }, OmicronZoneConfig { id: 0c52c762-2a0b-4970-9410-d46b02c00a5f (service), filesystem_pool: Some(ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::19]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External } } } }, OmicronZoneConfig { id: 33ad5699-51c6-4cfe-8eab-d5fefcbbc05d (service), filesystem_pool: Some(ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }), zone_type: Crucible { address: [fd00:1122:3344:101::1a]:32345, dataset: OmicronZoneDataset { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External } } } }] } file = sled-agent/src/rack_setup/service.rs:541 sled_address = [fd00:1122:3344:101::1]:12345
12152025-01-17T08:23:11.042ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::1]:44185
12162025-01-17T08:23:11.043ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12172025-01-17T08:23:11.043ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: InternalDns }, responder: ... }
12182025-01-17T08:23:11.057ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12192025-01-17T08:23:11.057ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: InternalDns }, responder: ... }
12202025-01-17T08:23:11.066ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12212025-01-17T08:23:11.066ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: InternalDns }, responder: ... }
12222025-01-17T08:23:11.076ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12232025-01-17T08:23:11.076ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Cockroach }, responder: ... }
12242025-01-17T08:23:11.085ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12252025-01-17T08:23:11.085ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Cockroach }, responder: ... }
12262025-01-17T08:23:11.095ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12272025-01-17T08:23:11.095ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Cockroach }, responder: ... }
12282025-01-17T08:23:11.104ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12292025-01-17T08:23:11.104ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Cockroach }, responder: ... }
12302025-01-17T08:23:11.113ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Cockroach }, responder: ... }) file = sled-storage/src/manager.rs:607
12312025-01-17T08:23:11.113ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Cockroach }, responder: ... }
12322025-01-17T08:23:11.123ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12332025-01-17T08:23:11.123ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12342025-01-17T08:23:11.134ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: ExternalDns }, responder: ... }) file = sled-storage/src/manager.rs:607
12352025-01-17T08:23:11.135ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: ExternalDns }, responder: ... }
12362025-01-17T08:23:11.144ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Clickhouse }, responder: ... }) file = sled-storage/src/manager.rs:607
12372025-01-17T08:23:11.144ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Clickhouse }, responder: ... }
12382025-01-17T08:23:11.155ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12392025-01-17T08:23:11.155ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, kind: Crucible }, responder: ... }
12402025-01-17T08:23:11.166ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12412025-01-17T08:23:11.166ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, kind: Crucible }, responder: ... }
12422025-01-17T08:23:11.176ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12432025-01-17T08:23:11.176ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, kind: Crucible }, responder: ... }
12442025-01-17T08:23:11.187ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12452025-01-17T08:23:11.187ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, kind: Crucible }, responder: ... }
12462025-01-17T08:23:11.197ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12472025-01-17T08:23:11.197ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, kind: Crucible }, responder: ... }
12482025-01-17T08:23:11.207ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12492025-01-17T08:23:11.207ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, kind: Crucible }, responder: ... }
12502025-01-17T08:23:11.218ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12512025-01-17T08:23:11.218ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, kind: Crucible }, responder: ... }
12522025-01-17T08:23:11.228ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12532025-01-17T08:23:11.228ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, kind: Crucible }, responder: ... }
12542025-01-17T08:23:11.238ZINFOSledAgent (StorageManager): Received NewFilesystem(NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: Crucible }, responder: ... }) file = sled-storage/src/manager.rs:607
12552025-01-17T08:23:11.238ZINFOSledAgent (StorageManager): add_dataset file = sled-storage/src/manager.rs:1478 request = NewFilesystemRequest { dataset_id: None, dataset_name: DatasetName { pool_name: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, kind: Crucible }, responder: ... }
12562025-01-17T08:23:11.249ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12572025-01-17T08:23:11.249ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:177
12582025-01-17T08:23:11.249ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:177
12592025-01-17T08:23:11.250ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12602025-01-17T08:23:11.366ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12612025-01-17T08:23:11.396ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12622025-01-17T08:23:11.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12632025-01-17T08:23:11.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12642025-01-17T08:23:11.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12652025-01-17T08:23:11.396ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12662025-01-17T08:23:11.410ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12672025-01-17T08:23:11.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12682025-01-17T08:23:11.410ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12692025-01-17T08:23:11.412ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12702025-01-17T08:23:11.558ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12712025-01-17T08:23:11.570ZINFOSledAgent (ServiceManager): Resolving switch zone addresses in DNS file = sled-agent/src/bootstrap/early_networking.rs:264
12722025-01-17T08:23:11.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12732025-01-17T08:23:11.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12742025-01-17T08:23:11.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12752025-01-17T08:23:11.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12762025-01-17T08:23:11.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12772025-01-17T08:23:11.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12782025-01-17T08:23:11.649ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
12792025-01-17T08:23:11.650ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46 file = illumos-utils/src/zone.rs:325
12802025-01-17T08:23:11.655ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8 file = illumos-utils/src/zone.rs:325
12812025-01-17T08:23:11.659ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951 file = illumos-utils/src/zone.rs:325
12822025-01-17T08:23:11.665ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3 file = illumos-utils/src/zone.rs:325
12832025-01-17T08:23:11.671ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078 file = illumos-utils/src/zone.rs:325
12842025-01-17T08:23:11.677ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5 file = illumos-utils/src/zone.rs:325
12852025-01-17T08:23:11.681ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426 file = illumos-utils/src/zone.rs:325
12862025-01-17T08:23:11.818ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46 file = illumos-utils/src/zone.rs:363
12872025-01-17T08:23:11.823ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8 file = illumos-utils/src/zone.rs:363
12882025-01-17T08:23:11.827ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951 file = illumos-utils/src/zone.rs:363
12892025-01-17T08:23:11.832ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3 file = illumos-utils/src/zone.rs:363
12902025-01-17T08:23:11.837ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078 file = illumos-utils/src/zone.rs:363
12912025-01-17T08:23:11.841ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5 file = illumos-utils/src/zone.rs:363
12922025-01-17T08:23:11.845ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426 file = illumos-utils/src/zone.rs:363
12932025-01-17T08:23:11.851ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11 file = illumos-utils/src/zone.rs:325
12942025-01-17T08:23:11.856ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a file = illumos-utils/src/zone.rs:325
12952025-01-17T08:23:11.861ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63 file = illumos-utils/src/zone.rs:325
12962025-01-17T08:23:11.867ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32 file = illumos-utils/src/zone.rs:325
12972025-01-17T08:23:11.873ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f file = illumos-utils/src/zone.rs:325
12982025-01-17T08:23:11.879ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d file = illumos-utils/src/zone.rs:325
12992025-01-17T08:23:11.885ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb file = illumos-utils/src/zone.rs:325
13002025-01-17T08:23:11.892ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11 file = illumos-utils/src/zone.rs:363
13012025-01-17T08:23:11.900ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a file = illumos-utils/src/zone.rs:363
13022025-01-17T08:23:11.908ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63 file = illumos-utils/src/zone.rs:363
13032025-01-17T08:23:11.916ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32 file = illumos-utils/src/zone.rs:363
13042025-01-17T08:23:11.925ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f file = illumos-utils/src/zone.rs:363
13052025-01-17T08:23:11.938ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d file = illumos-utils/src/zone.rs:363
13062025-01-17T08:23:11.951ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb file = illumos-utils/src/zone.rs:363
13072025-01-17T08:23:12.036ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13082025-01-17T08:23:12.147ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13092025-01-17T08:23:12.217ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13102025-01-17T08:23:12.275ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13112025-01-17T08:23:12.337ZINFOSledAgent (ServiceManager): Querying MGS to determine switch location addr = fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:281
13122025-01-17T08:23:12.339ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13132025-01-17T08:23:12.339ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13142025-01-17T08:23:12.397ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte1", ip: 172.30.1.5, mac: MacAddr6([168, 64, 37, 255, 150, 247]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13152025-01-17T08:23:12.397ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
13162025-01-17T08:23:12.399ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13172025-01-17T08:23:12.399ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13182025-01-17T08:23:12.462ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte2", ip: 172.30.2.7, mac: MacAddr6([168, 64, 37, 255, 130, 157]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13192025-01-17T08:23:12.462ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13202025-01-17T08:23:12.464ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13212025-01-17T08:23:12.464ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13222025-01-17T08:23:12.529ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte3", ip: 172.30.2.6, mac: MacAddr6([168, 64, 37, 255, 192, 254]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13232025-01-17T08:23:12.529ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13242025-01-17T08:23:12.535ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13252025-01-17T08:23:12.535ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13262025-01-17T08:23:12.601ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte4", ip: 172.30.2.5, mac: MacAddr6([168, 64, 37, 255, 198, 222]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.2.1 } }) }
13272025-01-17T08:23:12.601ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = nexus
13282025-01-17T08:23:12.603ZINFOSledAgent (ServiceManager): Found Switch0 at fd00:1122:3344:101::2 file = sled-agent/src/bootstrap/early_networking.rs:306
13292025-01-17T08:23:12.603ZINFOSledAgent (ServiceManager): Successfully looked up all expected switch zone underlay addresses addrs = {Switch0: fd00:1122:3344:101::2} file = sled-agent/src/bootstrap/early_networking.rs:198
13302025-01-17T08:23:12.663ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte5", ip: 172.30.1.6, mac: MacAddr6([168, 64, 37, 255, 248, 106]), slot: 0, vni: Vni { inner: 100 }, subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.1.1 } }) }
13312025-01-17T08:23:12.663ZINFOSledAgent (ServiceManager): creating NAT entry for service file = sled-agent/src/services.rs:1264 zone_type = external_dns
13322025-01-17T08:23:12.663ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:83
13332025-01-17T08:23:12.663ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:90
13342025-01-17T08:23:12.663ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:83
13352025-01-17T08:23:12.663ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:90
13362025-01-17T08:23:12.663ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:83
13372025-01-17T08:23:12.663ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:90
13382025-01-17T08:23:12.675ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.164 file = clients/dpd-client/src/lib.rs:118
13392025-01-17T08:23:12.677ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13402025-01-17T08:23:12.720ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.168 file = clients/dpd-client/src/lib.rs:118
13412025-01-17T08:23:12.726ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.167 file = clients/dpd-client/src/lib.rs:118
13422025-01-17T08:23:12.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13432025-01-17T08:23:12.730ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13442025-01-17T08:23:12.730ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:83
13452025-01-17T08:23:12.730ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:90
13462025-01-17T08:23:12.730ZINFOSledAgent (ServiceManager): no nat entry found for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:83
13472025-01-17T08:23:12.730ZINFOSledAgent (ServiceManager): creating nat entry for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:90
13482025-01-17T08:23:12.827ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.166 file = clients/dpd-client/src/lib.rs:118
13492025-01-17T08:23:12.831ZINFOSledAgent (ServiceManager): creation of nat entry successful for: 10.151.2.165 file = clients/dpd-client/src/lib.rs:118
13502025-01-17T08:23:12.835ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13512025-01-17T08:23:12.835ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
13522025-01-17T08:23:12.835ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6 file = illumos-utils/src/zone.rs:325
13532025-01-17T08:23:12.847ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f file = illumos-utils/src/zone.rs:325
13542025-01-17T08:23:12.861ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd file = illumos-utils/src/zone.rs:325
13552025-01-17T08:23:12.999ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6 file = illumos-utils/src/zone.rs:363
13562025-01-17T08:23:13.013ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f file = illumos-utils/src/zone.rs:363
13572025-01-17T08:23:13.022ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd file = illumos-utils/src/zone.rs:363
13582025-01-17T08:23:13.036ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525 file = illumos-utils/src/zone.rs:325
13592025-01-17T08:23:13.046ZINFOSledAgent (ServiceManager): Configuring new Omicron zone: oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d file = illumos-utils/src/zone.rs:325
13602025-01-17T08:23:13.071ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525 file = illumos-utils/src/zone.rs:363
13612025-01-17T08:23:13.077ZINFOSledAgent (ServiceManager): Installing Omicron zone: oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d file = illumos-utils/src/zone.rs:363
13622025-01-17T08:23:15.215ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService20'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::16'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::16'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='7e7c2578-f597-45ca-a620-e86ba6d715f4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13632025-01-17T08:23:15.215ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService23'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::18'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::18'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='cd7210f5-247a-4ea7-b2b9-58b7e994e5e8'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13642025-01-17T08:23:15.216ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService17'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::15'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0ab7c39f-5947-4112-8347-2ecc105352ff/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::15'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='e5083707-c33c-4535-b6ca-49e2a0812408'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13652025-01-17T08:23:15.216ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
13662025-01-17T08:23:15.228ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService22'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::1a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1a'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5d2ea0ad-4e14-4d51-a7e9-dfa2388fbbb5'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13672025-01-17T08:23:15.233ZINFOSledAgent (ServiceManager): Booting oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
13682025-01-17T08:23:15.238ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService15'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::14'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_028b6e25-416e-42c3-8d32-3331a24bdea1/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::14'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='5af8f6a4-9ae5-495f-b5f6-2dd5b825d269'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
13692025-01-17T08:23:15.238ZINFOSledAgent (ServiceManager): Booting oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
13702025-01-17T08:23:15.246ZINFOSledAgent (ServiceManager): Booting oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
13712025-01-17T08:23:15.253ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
13722025-01-17T08:23:15.759ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 37.305408ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
13732025-01-17T08:23:15.768ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 63.547677ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
13742025-01-17T08:23:15.777ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 34.448092ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
13752025-01-17T08:23:15.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 41.039976ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
13762025-01-17T08:23:15.797ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 58.59544ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
13772025-01-17T08:23:15.807ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 132.921441ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
13782025-01-17T08:23:15.822ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 117.152082ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
13792025-01-17T08:23:15.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 134.65071ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
13802025-01-17T08:23:15.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 143.934745ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
13812025-01-17T08:23:15.869ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 74.500684ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
13822025-01-17T08:23:15.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 184.882138ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
13832025-01-17T08:23:15.969ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 280.793484ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
13842025-01-17T08:23:15.993ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 253.404777ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
13852025-01-17T08:23:16.013ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 117.722187ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
13862025-01-17T08:23:16.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 198.31813ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
13872025-01-17T08:23:16.144ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 429.384167ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
13882025-01-17T08:23:16.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 260.014222ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
13892025-01-17T08:23:16.240ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 582.734842ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
13902025-01-17T08:23:16.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 420.970538ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
13912025-01-17T08:23:16.277ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 498.945565ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
13922025-01-17T08:23:16.431ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 956.895836ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
13932025-01-17T08:23:16.587ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 503.535506ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
13942025-01-17T08:23:16.693ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 1.194835439s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
13952025-01-17T08:23:16.787ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 506.215881ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
13962025-01-17T08:23:16.837ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 1.186896083s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
13972025-01-17T08:23:17.137ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 1.447227794s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
13982025-01-17T08:23:17.310ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 929.383829ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
13992025-01-17T08:23:17.401ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 675.394502ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
14002025-01-17T08:23:17.829ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService18'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::12'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::12'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='2aca4eba-062d-4768-af9b-b003670a62d6'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14012025-01-17T08:23:17.829ZINFOSledAgent (ServiceManager): Booting oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
14022025-01-17T08:23:17.902ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 879.672347ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
14032025-01-17T08:23:18.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 1.489844601s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
14042025-01-17T08:23:18.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 74.792737ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
14052025-01-17T08:23:18.090ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 986.645902ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
14062025-01-17T08:23:18.139ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 107.931264ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
14072025-01-17T08:23:18.139ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService24'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::8'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte1'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::8]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.5:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14082025-01-17T08:23:18.139ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
14092025-01-17T08:23:18.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 1.228872072s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
14102025-01-17T08:23:18.265ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 140.764694ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
14112025-01-17T08:23:18.381ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService14'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::11'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::11'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14122025-01-17T08:23:18.381ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService16'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::10'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::10'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14132025-01-17T08:23:18.381ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService12'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::f'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/pantry"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::f'/> <propval type="astring" name="listen_port" value='17000'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14142025-01-17T08:23:18.381ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
14152025-01-17T08:23:18.397ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
14162025-01-17T08:23:18.458ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 368.803301ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
14172025-01-17T08:23:18.459ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService21'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::19'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::19'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='86f00d83-774b-417d-adf4-ebc5b4f24da4'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14182025-01-17T08:23:18.459ZINFOSledAgent (ServiceManager): Booting oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
14192025-01-17T08:23:18.473ZINFOSledAgent (ServiceManager): Booting oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
14202025-01-17T08:23:18.529ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService19'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::13'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::13'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='ac272607-4c03-4bd2-bf3a-fcee84484e2a'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14212025-01-17T08:23:18.530ZINFOSledAgent (ServiceManager): Booting oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
14222025-01-17T08:23:18.553ZINFOSledAgent (ServiceManager): Profile for oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService13'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::17'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/crucible/agent"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="dataset" value='oxp_77842ceb-2fab-4804-a283-1a7c8f995913/crucible'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::17'/> <propval type="astring" name="listen_port" value='32345'/> <propval type="astring" name="uuid" value='b362f121-f8ad-4c91-895b-0b6e64f44c8e'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14232025-01-17T08:23:18.558ZINFOSledAgent (ServiceManager): Booting oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
14242025-01-17T08:23:18.734ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 616.322803ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
14252025-01-17T08:23:18.735ZINFOSledAgent (ServiceManager): Profile for oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService28'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::9'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte5'/> <propval type="astring" name="gateway" value='172.30.1.1'/> <propval type="astring" name="ip" value='172.30.1.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/external_dns"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::9]:5353'/> <propval type="astring" name="dns_address" value='172.30.1.6:53'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14262025-01-17T08:23:18.735ZINFOSledAgent (ServiceManager): Booting oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
14272025-01-17T08:23:18.808ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 696.373522ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
14282025-01-17T08:23:18.866ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 764.062583ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
14292025-01-17T08:23:18.891ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 74.648738ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
14302025-01-17T08:23:18.945ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 73.494618ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
14312025-01-17T08:23:18.977ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 117.969593ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
14322025-01-17T08:23:18.990ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 70.61955ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
14332025-01-17T08:23:19.001ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 33.456865ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
14342025-01-17T08:23:19.015ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 39.571316ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
14352025-01-17T08:23:19.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 75.303886ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
14362025-01-17T08:23:19.084ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 96.628537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
14372025-01-17T08:23:19.110ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 72.550297ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
14382025-01-17T08:23:19.141ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 72.449701ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
14392025-01-17T08:23:19.155ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 271.458827ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
14402025-01-17T08:23:19.166ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 160.925406ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
14412025-01-17T08:23:19.179ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 60.787206ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
14422025-01-17T08:23:19.193ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 1.323393241s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
14432025-01-17T08:23:19.203ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 65.959591ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
14442025-01-17T08:23:19.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 294.018595ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
14452025-01-17T08:23:19.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 102.90657ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
14462025-01-17T08:23:19.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 73.995463ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
14472025-01-17T08:23:19.252ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 124.807288ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
14482025-01-17T08:23:19.281ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 242.593249ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
14492025-01-17T08:23:19.321ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 117.856314ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
14502025-01-17T08:23:19.342ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 315.910572ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
14512025-01-17T08:23:19.354ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 257.343529ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
14522025-01-17T08:23:19.354ZINFOSledAgent (ServiceManager): Profile for oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService11'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::d'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/oximeter"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="id" value='0cc45a67-34ed-4014-ae46-f6e108da31b8'/> <propval type="astring" name="address" value='[fd00:1122:3344:101::d]:12223'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14532025-01-17T08:23:19.364ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 1.424490636s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
14542025-01-17T08:23:19.364ZINFOSledAgent (ServiceManager): Booting oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
14552025-01-17T08:23:19.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 219.812782ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
14562025-01-17T08:23:19.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 496.937932ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
14572025-01-17T08:23:19.451ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 505.74869ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
14582025-01-17T08:23:19.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 1.154249227s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
14592025-01-17T08:23:19.518ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 1.211301377s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
14602025-01-17T08:23:19.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 503.697649ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
14612025-01-17T08:23:19.544ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 365.065447ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
14622025-01-17T08:23:19.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 820.574853ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
14632025-01-17T08:23:19.583ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 50.697053ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
14642025-01-17T08:23:19.621ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 204.592261ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
14652025-01-17T08:23:19.630ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 524.427355ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
14662025-01-17T08:23:19.642ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 1.022105017s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
14672025-01-17T08:23:19.651ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 102.60993ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
14682025-01-17T08:23:19.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 581.461839ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
14692025-01-17T08:23:19.773ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 286.50766ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
14702025-01-17T08:23:19.847ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 693.13655ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
14712025-01-17T08:23:19.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 709.675101ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
14722025-01-17T08:23:19.951ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 652.938073ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
14732025-01-17T08:23:19.968ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 659.040762ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
14742025-01-17T08:23:20.051ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 885.075867ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
14752025-01-17T08:23:20.072ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 441.353928ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
14762025-01-17T08:23:20.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 1.352154968s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
14772025-01-17T08:23:20.346ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 1.033767169s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
14782025-01-17T08:23:20.390ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 859.670146ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
14792025-01-17T08:23:20.438ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 45.952307ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
14802025-01-17T08:23:20.494ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 69.812187ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
14812025-01-17T08:23:20.528ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 1.069364637s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
14822025-01-17T08:23:20.542ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 552.758011ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
14832025-01-17T08:23:20.558ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 1.460910849s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
14842025-01-17T08:23:20.593ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 227.335009ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
14852025-01-17T08:23:20.594ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService26'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::b'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte3'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.6'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14862025-01-17T08:23:20.594ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService27'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::a'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte4'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.5'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
14872025-01-17T08:23:20.594ZINFOSledAgent (ServiceManager): Booting oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
14882025-01-17T08:23:20.602ZINFOSledAgent (ServiceManager): Booting oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
14892025-01-17T08:23:20.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 1.422006575s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
14902025-01-17T08:23:20.741ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 1.120825165s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
14912025-01-17T08:23:20.757ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 1.166371909s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
14922025-01-17T08:23:20.772ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 537.709567ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
14932025-01-17T08:23:20.786ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 906.675106ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
14942025-01-17T08:23:20.798ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 607.90203ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
14952025-01-17T08:23:20.810ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 1.139115175s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
14962025-01-17T08:23:20.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 423.88281ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
14972025-01-17T08:23:20.897ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 53.330553ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
14982025-01-17T08:23:20.916ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 57.798062ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
14992025-01-17T08:23:20.947ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 1.39963411s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
15002025-01-17T08:23:20.958ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 61.065927ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
15012025-01-17T08:23:20.985ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 143.235072ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
15022025-01-17T08:23:21.037ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 237.636095ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
15032025-01-17T08:23:21.108ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 1.447371399s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
15042025-01-17T08:23:21.143ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 263.873748ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
15052025-01-17T08:23:21.193ZINFOSledAgent (ServiceManager): Profile for oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService25'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::c'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/opte-interface-setup"> <property_group type="application" name="config"> <propval type="astring" name="interface" value='opte2'/> <propval type="astring" name="gateway" value='172.30.2.1'/> <propval type="astring" name="ip" value='172.30.2.7'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/nexus"> <instance enabled="true" name="default"> <property_group type="application" name="config"> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="false" name="default"> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15062025-01-17T08:23:21.193ZINFOSledAgent (ServiceManager): Booting oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
15072025-01-17T08:23:21.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 1.21408707s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
15082025-01-17T08:23:21.276ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 965.783137ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
15092025-01-17T08:23:21.288ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 568.815108ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
15102025-01-17T08:23:21.319ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 1.095708227s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
15112025-01-17T08:23:21.393ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 1.32528124s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
15122025-01-17T08:23:21.410ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 67.327819ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
15132025-01-17T08:23:21.422ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 674.508258ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
15142025-01-17T08:23:21.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 417.021526ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
15152025-01-17T08:23:21.604ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 111.176539ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
15162025-01-17T08:23:21.635ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 1.032986557s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
15172025-01-17T08:23:21.646ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 741.041797ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
15182025-01-17T08:23:21.704ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 1.338334483s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
15192025-01-17T08:23:21.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 287.042118ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
15202025-01-17T08:23:21.863ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 635.380037ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
15212025-01-17T08:23:21.878ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 1.142854857s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
15222025-01-17T08:23:21.888ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 1.382122298s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
15232025-01-17T08:23:21.934ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 1.219936626s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
15242025-01-17T08:23:21.965ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 891.206977ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
15252025-01-17T08:23:22.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 306.202556ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
15262025-01-17T08:23:22.058ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 1.416854911s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
15272025-01-17T08:23:22.145ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 1.284909659s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
15282025-01-17T08:23:22.176ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 775.103609ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
15292025-01-17T08:23:22.260ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 1.293795931s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
15302025-01-17T08:23:22.363ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 656.487277ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
15312025-01-17T08:23:22.383ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 1.332534349s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
15322025-01-17T08:23:22.409ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 1.264723777s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
15332025-01-17T08:23:22.439ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 957.649444ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
15342025-01-17T08:23:22.496ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 504.470898ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
15352025-01-17T08:23:22.529ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 1.378335658s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
15362025-01-17T08:23:22.579ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 1.271577914s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
15372025-01-17T08:23:22.695ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 805.295798ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
15382025-01-17T08:23:22.749ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 501.171138ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
15392025-01-17T08:23:22.876ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 1.21274436s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
15402025-01-17T08:23:22.974ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 1.269207667s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
15412025-01-17T08:23:23.022ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 1.201752255s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
15422025-01-17T08:23:23.043ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 1.106840898s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
15432025-01-17T08:23:23.061ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 1.421544991s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
15442025-01-17T08:23:23.080ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 877.205859ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
15452025-01-17T08:23:23.172ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 1.370452339s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
15462025-01-17T08:23:23.269ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 1.077101248s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
15472025-01-17T08:23:23.291ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 969.843075ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
15482025-01-17T08:23:23.414ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 859.63896ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
15492025-01-17T08:23:23.447ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 1.34654303s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
15502025-01-17T08:23:23.493ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 1.206827983s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
15512025-01-17T08:23:23.515ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 1.071396804s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
15522025-01-17T08:23:23.570ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 750.83989ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
15532025-01-17T08:23:23.687ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 990.309478ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
15542025-01-17T08:23:23.728ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 821.74187ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
15552025-01-17T08:23:23.862ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 1.069697124s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
15562025-01-17T08:23:23.922ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 520.266597ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
15572025-01-17T08:23:23.973ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 1.038886214s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
15582025-01-17T08:23:24.104ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 1.12366579s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
15592025-01-17T08:23:24.165ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 1.18845023s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
15602025-01-17T08:23:24.237ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 663.179607ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
15612025-01-17T08:23:24.258ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 807.101409ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
15622025-01-17T08:23:24.274ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 1.382530174s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
15632025-01-17T08:23:24.289ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 1.282642297s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
15642025-01-17T08:23:24.333ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 1.198371576s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
15652025-01-17T08:23:24.359ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 1.412663429s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
15662025-01-17T08:23:24.456ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 1.342129387s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
15672025-01-17T08:23:24.495ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 826.768725ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
15682025-01-17T08:23:24.554ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 1.443515484s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
15692025-01-17T08:23:24.563ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 655.845104ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
15702025-01-17T08:23:24.598ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 921.244563ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
15712025-01-17T08:23:24.690ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 529.441657ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
15722025-01-17T08:23:24.711ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 1.402050991s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
15732025-01-17T08:23:24.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 1.153384413s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
15742025-01-17T08:23:24.910ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 775.960583ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
15752025-01-17T08:23:24.942ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 622.034432ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
15762025-01-17T08:23:25.027ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 965.164336ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
15772025-01-17T08:23:25.079ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 523.297706ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
15782025-01-17T08:23:25.232ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 524.40727ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
15792025-01-17T08:23:25.247ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 756.438576ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
15802025-01-17T08:23:25.262ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 578.085322ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
15812025-01-17T08:23:25.335ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 728.774159ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
15822025-01-17T08:23:25.367ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 1.261514673s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
15832025-01-17T08:23:25.408ZINFOSledAgent (ServiceManager): Profile for oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="oxide/zone-network-setup"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlService10'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="static_addr" value='fd00:1122:3344:101::e'/> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/ssh"> <instance enabled="false" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::e'/> <propval type="astring" name="listen_port" value='8123'/> <propval type="astring" name="store" value='/data'/> </property_group> </instance> </service> <service version="1" type="service" name="network/dns/install"> <property_group type="application" name="install_props"> <property type="net_address" name="nameserver"> <net_address_list> <value_node value="fd00:1122:3344:1::1" /> <value_node value="fd00:1122:3344:2::1" /> <value_node value="fd00:1122:3344:3::1" /> </net_address_list> </property> </property_group> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="network/dns/client"> <instance enabled="true" name="default"> </instance> </service> <service version="1" type="service" name="oxide/clickhouse-admin-single"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="http_address" value='[fd00:1122:3344:101::e]:8888'/> <propval type="astring" name="ch_address" value='[fd00:1122:3344:101::e]:9000'/> <propval type="astring" name="ch_binary" value='/opt/oxide/clickhouse/clickhouse'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34
15842025-01-17T08:23:25.408ZINFOSledAgent (ServiceManager): Booting oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46 zone file = illumos-utils/src/running_zone.rs:488 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
15852025-01-17T08:23:25.533ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 1.428853626s file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
15862025-01-17T08:23:25.547ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 1.405518506s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
15872025-01-17T08:23:25.577ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 1.38869606s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
15882025-01-17T08:23:25.592ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 1.20146893s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
15892025-01-17T08:23:25.614ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 993.975919ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
15902025-01-17T08:23:25.654ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 47.78932ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
15912025-01-17T08:23:25.671ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 1.251957937s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
15922025-01-17T08:23:25.699ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 1.499472649s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
15932025-01-17T08:23:25.714ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 115.224917ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
15942025-01-17T08:23:25.825ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 1.192962407s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
15952025-01-17T08:23:25.925ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 1.045556343s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
15962025-01-17T08:23:25.956ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 1.418536966s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
15972025-01-17T08:23:26.032ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 225.156693ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
15982025-01-17T08:23:26.088ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 1.17054541s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
15992025-01-17T08:23:26.102ZWARNSledAgent (producer-registration-task): failed to register as a producer with Nexus, will retry delay = 25.550722784s error = "Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/metrics/producers)" file = oximeter/producer/src/lib.rs:420 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
16002025-01-17T08:23:26.106ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 918.433537ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
16012025-01-17T08:23:26.120ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 576.376514ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
16022025-01-17T08:23:26.131ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 1.107858713s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
16032025-01-17T08:23:26.146ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 637.311789ms file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
16042025-01-17T08:23:26.157ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 1.015043454s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
16052025-01-17T08:23:26.171ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb") failed: Property not found. retry in 1.434814804s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
16062025-01-17T08:23:26.271ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 543.43445ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16072025-01-17T08:23:26.620ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 721.037625ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
16082025-01-17T08:23:26.640ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 1.426454887s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
16092025-01-17T08:23:26.709ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 1.391075064s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
16102025-01-17T08:23:26.806ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d") failed: Property not found. retry in 1.337513001s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
16112025-01-17T08:23:26.824ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d") failed: Property not found. retry in 1.257901341s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
16122025-01-17T08:23:26.839ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 1.156329201s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16132025-01-17T08:23:26.941ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 1.454295842s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
16142025-01-17T08:23:26.953ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 602.184923ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
16152025-01-17T08:23:26.966ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 1.116091661s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
16162025-01-17T08:23:26.982ZWARNSledAgent (ServiceManager): wait for service Some("oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8") failed: Property not found. retry in 922.621419ms file = illumos-utils/src/svc.rs:42 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
16172025-01-17T08:23:26.998ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 903.152753ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
16182025-01-17T08:23:27.036ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f") failed: Property not found. retry in 1.015862723s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
16192025-01-17T08:23:27.050ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3") failed: Property not found. retry in 1.046145136s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
16202025-01-17T08:23:27.189ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63") failed: Property not found. retry in 1.407851971s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
16212025-01-17T08:23:27.214ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 534.353771ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
16222025-01-17T08:23:27.255ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 1.02664952s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
16232025-01-17T08:23:27.272ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 503.299337ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
16242025-01-17T08:23:27.357ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078") failed: Property not found. retry in 777.716613ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
16252025-01-17T08:23:27.392ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 1.072925341s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
16262025-01-17T08:23:27.571ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951") failed: Property not found. retry in 590.204153ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
16272025-01-17T08:23:27.770ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32") failed: Property not found. retry in 1.047977601s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
16282025-01-17T08:23:27.790ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426") failed: Property not found. retry in 856.085822ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
16292025-01-17T08:23:27.920ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11") failed: Property not found. retry in 1.48256556s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
16302025-01-17T08:23:28.028ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 1.175338587s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16312025-01-17T08:23:28.101ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 1.048276963s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
16322025-01-17T08:23:28.134ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 1.204801374s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
16332025-01-17T08:23:28.270ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5") failed: Property not found. retry in 986.819314ms file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
16342025-01-17T08:23:28.407ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 659.228171ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
16352025-01-17T08:23:28.432ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 1.046029602s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
16362025-01-17T08:23:28.486ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 1.496782223s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
16372025-01-17T08:23:29.089ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 935.955854ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
16382025-01-17T08:23:29.170ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 812.546071ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
16392025-01-17T08:23:29.224ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 507.387601ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16402025-01-17T08:23:29.358ZWARNSledAgent (ServiceManager): wait for service Some("oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6") failed: Property not found. retry in 1.05353039s file = illumos-utils/src/svc.rs:42 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
16412025-01-17T08:23:29.503ZWARNSledAgent (ServiceManager): wait for service Some("oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a") failed: Property not found. retry in 1.478528589s file = illumos-utils/src/svc.rs:42 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
16422025-01-17T08:23:29.753ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 1.154791018s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16432025-01-17T08:23:30.005ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 645.609353ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
16442025-01-17T08:23:30.026ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 790.803571ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
16452025-01-17T08:23:30.047ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525") failed: Property not found. retry in 894.125164ms file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
16462025-01-17T08:23:30.669ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f") failed: Property not found. retry in 1.177184238s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
16472025-01-17T08:23:30.858ZWARNSledAgent (ServiceManager): wait for service Some("oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd") failed: Property not found. retry in 1.333002743s file = illumos-utils/src/svc.rs:42 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
16482025-01-17T08:23:30.928ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 707.302752ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16492025-01-17T08:23:31.652ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 931.509491ms file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16502025-01-17T08:23:32.594ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 1.016937328s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16512025-01-17T08:23:33.623ZWARNSledAgent (ServiceManager): wait for service Some("oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46") failed: Property not found. retry in 1.064871575s file = illumos-utils/src/svc.rs:42 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16522025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_18904103-4d17-4503-9e6b-f36462ac2ff6
16532025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_clickhouse_f862f3d3-2aa5-4e09-b5d5-80d66f1fee46
16542025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_oximeter_0cc45a67-34ed-4014-ae46-f6e108da31b8
16552025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_74a4affd-587b-4477-baec-99fd2f4ce951
16562025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_69391479-0b2e-48ec-af22-d5eebf5902c3
16572025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_c34158a3-fac5-4036-bee4-fac8eb171c5f
16582025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_44709bbb-3699-4a47-b96b-24dd8f2f9078
16592025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_c991210e-8bfe-49d4-9557-11fb49b643d5
16602025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_19f23d34-e15e-4f8e-9774-d53b0a1078cd
16612025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_pantry_48bbb14c-7d9a-4043-814c-748e60d2d426
16622025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_nexus_b72586ef-ab31-4002-9c99-4f4040a5f525
16632025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_external_dns_ab585232-40d2-4a9e-a5a8-6d9e5f36808d
16642025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_85d89493-0cfa-47c2-80e7-63ba29ed0c11
16652025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_dc6f27b6-8574-4b9a-a3c4-60ad07fe4d2a
16662025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_c7d58af7-8c60-493b-a5fd-9efe25f43b63
16672025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_c2bd9e35-0da2-4024-9de4-455197bdef32
16682025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_0c52c762-2a0b-4970-9410-d46b02c00a5f
16692025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_33ad5699-51c6-4cfe-8eab-d5fefcbbc05d
16702025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Zone started file = sled-agent/src/services.rs:3319 zone = oxz_crucible_2ea3a990-cf29-4ece-a3c3-c643a80e29bb
16712025-01-17T08:23:34.716ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16722025-01-17T08:23:34.722ZINFOSledAgent (ServiceManager): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/.omicron-zones.json.tmp file = common/src/ledger.rs:199
16732025-01-17T08:23:34.723ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 23680330 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::1]:44185 req_id = d800a2fb-dc5e-44cb-9e2a-1fec8d8c35ac response_code = 204 uri = /omicron-zones
16742025-01-17T08:23:34.726ZINFOSledAgent (RSS): Finished setting up services file = sled-agent/src/rack_setup/service.rs:1415
16752025-01-17T08:23:34.727ZINFOSledAgent (RSS): Handing off control to Nexus file = sled-agent/src/rack_setup/service.rs:790
16762025-01-17T08:23:34.728ZINFOSledAgent (RSS): Nexus address: [fd00:1122:3344:101::b]:12221 file = sled-agent/src/rack_setup/service.rs:803
16772025-01-17T08:23:34.760ZINFOSledAgent (RSS): rack_network_config: RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.2.174, infra_ip_last: 10.151.2.174, ports: [ PortConfigV2 { addresses: [ UplinkAddressConfig { address: V4( Ipv4Net { addr: 10.151.2.174, width: 24, }, ), vlan_id: None, }, ], autoneg: false, bgp_peers: [], lldp: None, port: "qsfp0", routes: [ RouteConfig { destination: V4( Ipv4Net { addr: 0.0.0.0, width: 0, }, ), nexthop: 10.151.2.100, rib_priority: None, vlan_id: None, }, ], switch: Switch0, tx_eq: None, uplink_port_fec: Some( None, ), uplink_port_speed: Speed40G, }, ], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56, }, } file = sled-agent/src/rack_setup/service.rs:1017
16782025-01-17T08:23:34.761ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16792025-01-17T08:23:34.858ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16802025-01-17T08:23:35.019ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16812025-01-17T08:23:35.193ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16822025-01-17T08:23:35.385ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16832025-01-17T08:23:35.589ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16842025-01-17T08:23:35.793ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16852025-01-17T08:23:36.238ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16862025-01-17T08:23:36.734ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16872025-01-17T08:23:37.142ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16882025-01-17T08:23:37.583ZINFOSledAgent (RSS): Failed to handoff to nexus: Communication Error: error sending request for url (http://[fd00:1122:3344:101::b]:12221/racks/d35a4c82-5298-4dae-8513-0a85ba980a8f/initialization-complete) file = sled-agent/src/rack_setup/service.rs:1079
16892025-01-17T08:23:39.599ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "69ea123f-67e9-4cf6-b47a-5221124063cf", "content-length": "173", "date": "Fri, 17 Jan 2025 08:23:39 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d35a4c82-5298-4dae-8513-0a85ba980a8f\"", request_id: "69ea123f-67e9-4cf6-b47a-5221124063cf" } file = sled-agent/src/rack_setup/service.rs:1079
16902025-01-17T08:23:40.219ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "c1107b8d-3f36-4fa5-b39d-6729098bd7ce", "content-length": "173", "date": "Fri, 17 Jan 2025 08:23:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d35a4c82-5298-4dae-8513-0a85ba980a8f\"", request_id: "c1107b8d-3f36-4fa5-b39d-6729098bd7ce" } file = sled-agent/src/rack_setup/service.rs:1079
16912025-01-17T08:23:41.062ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:56132
16922025-01-17T08:23:41.062ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 27 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:56132 req_id = 7ea329d1-e0aa-4aa9-80de-c952b6a4fc12 response_code = 200 uri = /baseboard
16932025-01-17T08:23:41.071ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "91d5929c-21b9-4d3a-b7b2-b5d84d5d1488", "content-length": "173", "date": "Fri, 17 Jan 2025 08:23:40 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d35a4c82-5298-4dae-8513-0a85ba980a8f\"", request_id: "91d5929c-21b9-4d3a-b7b2-b5d84d5d1488" } file = sled-agent/src/rack_setup/service.rs:1079
16942025-01-17T08:23:41.675ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "69ea8f50-e3dd-4f2f-bc1d-a623acb69056", "content-length": "173", "date": "Fri, 17 Jan 2025 08:23:41 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d35a4c82-5298-4dae-8513-0a85ba980a8f\"", request_id: "69ea8f50-e3dd-4f2f-bc1d-a623acb69056" } file = sled-agent/src/rack_setup/service.rs:1079
16952025-01-17T08:23:43.314ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "dbede15f-80b3-45b1-99e8-5ad6e0c3ad52", "content-length": "173", "date": "Fri, 17 Jan 2025 08:23:43 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: rack with id \"d35a4c82-5298-4dae-8513-0a85ba980a8f\"", request_id: "dbede15f-80b3-45b1-99e8-5ad6e0c3ad52" } file = sled-agent/src/rack_setup/service.rs:1079
16962025-01-17T08:23:46.521ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "83d6a927-98b7-4427-b5b0-828986379b3a", "content-length": "173", "date": "Fri, 17 Jan 2025 08:23:46 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fbac3378-7daf-4aef-b0f5-d2cd5264f30e\"", request_id: "83d6a927-98b7-4427-b5b0-828986379b3a" } file = sled-agent/src/rack_setup/service.rs:1079
16972025-01-17T08:23:49.456ZINFOSledAgent (RSS): Failed to handoff to nexus: Error Response: status: 404 Not Found; headers: {"content-type": "application/json", "x-request-id": "84378126-f52b-4f68-9410-f5453e7e0456", "content-length": "173", "date": "Fri, 17 Jan 2025 08:23:49 GMT"}; value: Error { error_code: Some("ObjectNotFound"), message: "not found: sled with id \"fbac3378-7daf-4aef-b0f5-d2cd5264f30e\"", request_id: "84378126-f52b-4f68-9410-f5453e7e0456" } file = sled-agent/src/rack_setup/service.rs:1079
16982025-01-17T08:23:51.191ZINFOSledAgent (NexusNotifierTask): Successfully put SledAgentInfo to nexus file = sled-agent/src/nexus.rs:500 new_generation = 1 old_generation = 1 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
16992025-01-17T08:23:51.277ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50376
17002025-01-17T08:23:51.277ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17012025-01-17T08:23:51.277ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17022025-01-17T08:23:51.277ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:177
17032025-01-17T08:23:51.278ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:177
17042025-01-17T08:23:51.288ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17052025-01-17T08:23:51.288ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_028b6e25-416e-42c3-8d32-3331a24bdea1
17062025-01-17T08:23:51.311ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17072025-01-17T08:23:51.311ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739
17082025-01-17T08:23:51.329ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17092025-01-17T08:23:51.329ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0ab7c39f-5947-4112-8347-2ecc105352ff
17102025-01-17T08:23:51.347ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17112025-01-17T08:23:51.347ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f
17122025-01-17T08:23:51.368ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17132025-01-17T08:23:51.369ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b
17142025-01-17T08:23:51.389ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17152025-01-17T08:23:51.389ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77842ceb-2fab-4804-a283-1a7c8f995913
17162025-01-17T08:23:51.407ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17172025-01-17T08:23:51.407ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab
17182025-01-17T08:23:51.428ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17192025-01-17T08:23:51.428ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded
17202025-01-17T08:23:51.448ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17212025-01-17T08:23:51.448ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0
17222025-01-17T08:23:51.459ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181730 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50376 req_id = bfcf4bf6-3869-46ae-9cb4-13ca60bf413a response_code = 200 uri = /inventory
17232025-01-17T08:23:54.360ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:47186
17242025-01-17T08:23:54.362ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17252025-01-17T08:23:54.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17262025-01-17T08:23:54.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17272025-01-17T08:23:54.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17282025-01-17T08:23:54.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17292025-01-17T08:23:54.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17302025-01-17T08:23:54.362ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17312025-01-17T08:23:54.362ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2491 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:47186 req_id = 69e18f6f-403b-4a14-a518-d64106bb32b7 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17322025-01-17T08:23:54.364ZINFOSledAgent (RSS): Handoff to Nexus is complete file = sled-agent/src/rack_setup/service.rs:1089
17332025-01-17T08:23:54.367ZINFOSledAgent (RSS): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17342025-01-17T08:23:54.368ZINFOSledAgent (RSS): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/.rss-plan-completed.marker.tmp file = common/src/ledger.rs:199
17352025-01-17T08:23:54.440ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46086
17362025-01-17T08:23:54.441ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17372025-01-17T08:23:54.441ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17382025-01-17T08:23:54.441ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17392025-01-17T08:23:54.441ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17402025-01-17T08:23:54.441ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17412025-01-17T08:23:54.441ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17422025-01-17T08:23:54.441ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17432025-01-17T08:23:54.441ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 278 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:46086 req_id = cc1c0700-9e3b-49ad-a79a-f139ea99e68f response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17442025-01-17T08:23:54.727ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:55778
17452025-01-17T08:23:54.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17462025-01-17T08:23:54.727ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
17472025-01-17T08:23:54.727ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:177
17482025-01-17T08:23:54.727ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:177
17492025-01-17T08:23:54.738ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17502025-01-17T08:23:54.738ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_028b6e25-416e-42c3-8d32-3331a24bdea1
17512025-01-17T08:23:54.765ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17522025-01-17T08:23:54.765ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739
17532025-01-17T08:23:54.786ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17542025-01-17T08:23:54.786ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0ab7c39f-5947-4112-8347-2ecc105352ff
17552025-01-17T08:23:54.807ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17562025-01-17T08:23:54.807ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f
17572025-01-17T08:23:54.833ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17582025-01-17T08:23:54.833ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b
17592025-01-17T08:23:54.855ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17602025-01-17T08:23:54.855ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77842ceb-2fab-4804-a283-1a7c8f995913
17612025-01-17T08:23:54.875ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17622025-01-17T08:23:54.875ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab
17632025-01-17T08:23:54.897ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17642025-01-17T08:23:54.897ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded
17652025-01-17T08:23:54.918ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
17662025-01-17T08:23:54.918ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0
17672025-01-17T08:23:54.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202311 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:55778 req_id = 0ca5bded-7ac1-4fe3-a30e-6f4bd5fb4389 response_code = 200 uri = /inventory
17682025-01-17T08:23:55.962ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37805
17692025-01-17T08:23:55.962ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17702025-01-17T08:23:55.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17712025-01-17T08:23:55.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17722025-01-17T08:23:55.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17732025-01-17T08:23:55.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17742025-01-17T08:23:55.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17752025-01-17T08:23:55.962ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17762025-01-17T08:23:55.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 341 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:37805 req_id = 5d097adf-bf57-4f69-881d-22915c4a2d3e response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17772025-01-17T08:23:56.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56555
17782025-01-17T08:23:56.240ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
17792025-01-17T08:23:56.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17802025-01-17T08:23:56.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17812025-01-17T08:23:56.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
17822025-01-17T08:23:56.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17832025-01-17T08:23:56.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
17842025-01-17T08:23:56.240ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
17852025-01-17T08:23:56.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 293 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56555 req_id = 2e474462-ec49-4f7a-85d5-ae315ab4d26d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
17862025-01-17T08:24:03.679ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37545
17872025-01-17T08:24:03.681ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1393 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37545 req_id = 33b21381-7b34-41f2-970a-ff07fc0fe6f7 response_code = 200 uri = /vpc-routes
17882025-01-17T08:24:03.754ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
17892025-01-17T08:24:03.754ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 626 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37545 req_id = 2a4a81b3-d862-40e5-8a1b-99d53dc2b954 response_code = 204 uri = /eip-gateways
17902025-01-17T08:24:03.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1088 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:37545 req_id = 6df1e03b-54ac-41d6-b852-b806b4d5b095 response_code = 204 uri = /vpc-routes
17912025-01-17T08:24:11.094ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:41872
17922025-01-17T08:24:11.094ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 32 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:41872 req_id = 5cf80732-38c8-46f4-9dc2-9b2c2962f140 response_code = 200 uri = /baseboard
17932025-01-17T08:24:12.051ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39747
17942025-01-17T08:24:12.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39747 req_id = 01018495-38f4-4dc9-a809-aeee952d52fb response_code = 200 uri = /vpc-routes
17952025-01-17T08:24:12.111ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
17962025-01-17T08:24:12.111ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39747 req_id = e0cd2130-7a05-4fbd-b12b-11d9fc44edc8 response_code = 204 uri = /eip-gateways
17972025-01-17T08:24:12.122ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39747 req_id = 4c090113-5f94-4b60-b2a6-b86d989c3c61 response_code = 204 uri = /vpc-routes
17982025-01-17T08:24:12.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55647
17992025-01-17T08:24:12.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 128 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55647 req_id = fa26a1bf-cbff-4652-a24f-0a25d483a44b response_code = 200 uri = /v2p
18002025-01-17T08:24:12.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39457
18012025-01-17T08:24:12.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18022025-01-17T08:24:12.348ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18032025-01-17T08:24:12.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111887 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39457 req_id = 3a915468-ba9a-47a1-881d-ea7d2b4f4311 response_code = 204 uri = /switch-ports
18042025-01-17T08:24:12.404ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39457 req_id = 307cf60d-c19b-44bd-96f1-eaf484014bf5 response_code = 200 uri = /network-bootstore-config
18052025-01-17T08:24:12.446ZINFOSledAgent (bootstore): Attempting to update network config with generation: 2, current_generation: 1 file = bootstore/src/schemes/v0/peer.rs:564 peer_id = pc-sock-i86pc
18062025-01-17T08:24:12.447ZINFOSledAgent (bootstore): Writing ledger to /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18072025-01-17T08:24:12.448ZINFOSledAgent (bootstore): Writing ledger to /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/cluster/.bootstore-network-config.json.tmp file = common/src/ledger.rs:199 peer_id = pc-sock-i86pc
18082025-01-17T08:24:12.449ZINFOSledAgent (bootstore): Broadcasting network config with generation 2 file = bootstore/src/schemes/v0/peer.rs:648 peer_id = pc-sock-i86pc
18092025-01-17T08:24:12.449ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 4196 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39457 req_id = 781410b2-c9fc-4e3a-bc5b-ecb9baf6effb response_code = 204 uri = /network-bootstore-config
18102025-01-17T08:24:13.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:45228
18112025-01-17T08:24:13.961ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:45228 req_id = b48011f3-a41d-4a5b-90f4-23fc5faff418 response_code = 200 uri = /vpc-routes
18122025-01-17T08:24:14.006ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
18132025-01-17T08:24:14.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45228 req_id = 2b9a978e-ff4c-460b-a422-e57c4dba2547 response_code = 204 uri = /eip-gateways
18142025-01-17T08:24:14.015ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:45228 req_id = 8d08b759-e3c1-460b-9af4-b6a7979d554b response_code = 204 uri = /vpc-routes
18152025-01-17T08:24:14.100ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57117
18162025-01-17T08:24:14.100ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57117 req_id = 27cf4224-b220-4bb7-9194-0762a2b03c22 response_code = 200 uri = /v2p
18172025-01-17T08:24:14.116ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56328
18182025-01-17T08:24:14.116ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18192025-01-17T08:24:14.150ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18202025-01-17T08:24:14.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87110 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56328 req_id = 2caa69d7-762f-4eb3-b35f-73611dea5505 response_code = 204 uri = /switch-ports
18212025-01-17T08:24:14.203ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56328 req_id = 93b4e585-6327-4228-bdef-7230c95d1cf1 response_code = 200 uri = /network-bootstore-config
18222025-01-17T08:24:18.898ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57681
18232025-01-17T08:24:18.899ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57681 req_id = 821e5899-527e-4a94-b824-37b02cfe4a46 response_code = 200 uri = /vpc-routes
18242025-01-17T08:24:18.948ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
18252025-01-17T08:24:18.948ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57681 req_id = 673a321e-4a08-40f1-a383-f22d252428f1 response_code = 204 uri = /eip-gateways
18262025-01-17T08:24:18.958ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 230 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:57681 req_id = 8cc0b2e1-dda6-47d1-95c9-faa5084d61d3 response_code = 204 uri = /vpc-routes
18272025-01-17T08:24:18.968ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37114
18282025-01-17T08:24:18.968ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37114 req_id = 0892f1bb-44cc-417b-b142-fce9ea01f79b response_code = 200 uri = /v2p
18292025-01-17T08:24:18.994ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64307
18302025-01-17T08:24:18.994ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18312025-01-17T08:24:19.036ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18322025-01-17T08:24:19.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101427 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64307 req_id = f2cfbfd0-16ed-4ce5-a910-19ad01fb716a response_code = 204 uri = /switch-ports
18332025-01-17T08:24:19.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64307 req_id = c7160d4b-b745-488c-8cd5-b28e959aa100 response_code = 200 uri = /network-bootstore-config
18342025-01-17T08:24:23.496ZINFOSledAgent (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:48872 remote_addr = [fd00:1122:3344:101::d]:64355 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18352025-01-17T08:24:23.510ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 13610 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = a8e09922-997b-4382-9856-9037f3243e87 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18362025-01-17T08:24:41.126ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39785
18372025-01-17T08:24:41.127ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39785 req_id = 89d6a36d-fe9a-44a2-ae8b-541864e0d7cd response_code = 200 uri = /baseboard
18382025-01-17T08:24:42.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43679
18392025-01-17T08:24:42.150ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43679 req_id = d89e267a-ec31-42ca-9b0c-b707b00cfea6 response_code = 200 uri = /vpc-routes
18402025-01-17T08:24:42.198ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
18412025-01-17T08:24:42.198ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43679 req_id = 4a303207-bdff-4ba9-b309-6f7458403d2f response_code = 204 uri = /eip-gateways
18422025-01-17T08:24:42.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48465
18432025-01-17T08:24:42.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 136 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48465 req_id = ca0cebc2-b1dc-4d4b-8459-ef0a36fa1437 response_code = 200 uri = /v2p
18442025-01-17T08:24:42.285ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 167 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43679 req_id = a7b1c776-baf1-4e3f-ad82-da022def8d13 response_code = 204 uri = /vpc-routes
18452025-01-17T08:24:42.364ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35974
18462025-01-17T08:24:42.364ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18472025-01-17T08:24:42.401ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18482025-01-17T08:24:42.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89765 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35974 req_id = 2460a7d1-3267-417c-97cf-acb67317bbaa response_code = 204 uri = /switch-ports
18492025-01-17T08:24:42.454ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35974 req_id = f5bae11f-9109-4b22-81ea-7aee6963413b response_code = 200 uri = /network-bootstore-config
18502025-01-17T08:24:44.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62089
18512025-01-17T08:24:44.135ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62089 req_id = aeba90f9-f481-4784-8ecf-fc5a97ba6d08 response_code = 200 uri = /vpc-routes
18522025-01-17T08:24:44.191ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
18532025-01-17T08:24:44.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62089 req_id = 42f27e51-4fbf-47ca-bb87-4d9aac0b7377 response_code = 204 uri = /eip-gateways
18542025-01-17T08:24:44.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62089 req_id = e7c56450-2fb6-4c79-8a07-68b513f5df63 response_code = 204 uri = /vpc-routes
18552025-01-17T08:24:44.326ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38954
18562025-01-17T08:24:44.326ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 138 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38954 req_id = cc304abd-96a9-4acb-9171-330c8d09bb79 response_code = 200 uri = /v2p
18572025-01-17T08:24:44.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43194
18582025-01-17T08:24:44.436ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18592025-01-17T08:24:44.470ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18602025-01-17T08:24:44.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88726 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43194 req_id = 3840cace-60ad-47d9-84f0-0ddc5d25d26e response_code = 204 uri = /switch-ports
18612025-01-17T08:24:44.525ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43194 req_id = 3dfb8728-082e-42bb-83bf-a3ad8ac9c2fa response_code = 200 uri = /network-bootstore-config
18622025-01-17T08:24:49.045ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33633
18632025-01-17T08:24:49.045ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33633 req_id = 28d65b45-da3f-4474-8cb2-b9b42c82a9b1 response_code = 200 uri = /vpc-routes
18642025-01-17T08:24:49.060ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
18652025-01-17T08:24:49.060ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33633 req_id = b6310a1a-c8a6-4890-adf7-a81e7a5703ae response_code = 204 uri = /eip-gateways
18662025-01-17T08:24:49.071ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33633 req_id = 86205292-7bc6-4876-b63a-c9b0427047a7 response_code = 204 uri = /vpc-routes
18672025-01-17T08:24:49.174ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47834
18682025-01-17T08:24:49.174ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47834 req_id = 579de955-bc6a-4b15-8d12-940c4b1b3482 response_code = 200 uri = /v2p
18692025-01-17T08:24:49.232ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55969
18702025-01-17T08:24:49.232ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18712025-01-17T08:24:49.270ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18722025-01-17T08:24:49.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90780 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:55969 req_id = 8f3ab529-367a-4f8e-a97d-b19bb24d1463 response_code = 204 uri = /switch-ports
18732025-01-17T08:24:49.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 151 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55969 req_id = e575f398-0a50-48db-b8e3-f14e10ab7ded response_code = 200 uri = /network-bootstore-config
18742025-01-17T08:24:53.504ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7008 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 2f02a9b7-b645-4631-aff9-34bec5eb1ff6 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
18752025-01-17T08:25:11.161ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39843
18762025-01-17T08:25:11.161ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39843 req_id = 469c94cd-430d-4ba2-9327-e563a63f54a2 response_code = 200 uri = /baseboard
18772025-01-17T08:25:12.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48944
18782025-01-17T08:25:12.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48944 req_id = 2310a687-ad23-426a-9586-ddd55a421b34 response_code = 200 uri = /vpc-routes
18792025-01-17T08:25:12.134ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
18802025-01-17T08:25:12.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48944 req_id = b4e79a23-d467-4267-b2f0-9b13e650bfdf response_code = 204 uri = /eip-gateways
18812025-01-17T08:25:12.144ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:48944 req_id = 7cf9168e-dbad-46fd-9420-6717f49de2cb response_code = 204 uri = /vpc-routes
18822025-01-17T08:25:12.227ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:32999
18832025-01-17T08:25:12.227ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:32999 req_id = c2d3b4e9-bc7d-4d0b-ba46-ca29f8285f1e response_code = 200 uri = /v2p
18842025-01-17T08:25:12.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41965
18852025-01-17T08:25:12.278ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18862025-01-17T08:25:12.316ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18872025-01-17T08:25:12.370ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92032 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:41965 req_id = 365bc5f4-ff3d-4868-b54b-19cfb1897e71 response_code = 204 uri = /switch-ports
18882025-01-17T08:25:12.371ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41965 req_id = 9c47b0c1-94a1-47b1-adfb-ca2cd91071e6 response_code = 200 uri = /network-bootstore-config
18892025-01-17T08:25:14.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39537
18902025-01-17T08:25:14.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39537 req_id = e3e90172-b5b3-48b4-9572-2eb0992452a1 response_code = 200 uri = /vpc-routes
18912025-01-17T08:25:14.064ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
18922025-01-17T08:25:14.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39537 req_id = 010828ea-d97f-402b-859d-19c8468b8c3c response_code = 204 uri = /eip-gateways
18932025-01-17T08:25:14.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 515 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39537 req_id = bcdd7b09-4e2f-44bd-a752-c4a064bd619a response_code = 204 uri = /vpc-routes
18942025-01-17T08:25:14.163ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48743
18952025-01-17T08:25:14.163ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48743 req_id = ba8873c7-c5ba-4664-8b5b-0e541873c06f response_code = 200 uri = /v2p
18962025-01-17T08:25:14.165ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53298
18972025-01-17T08:25:14.165ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
18982025-01-17T08:25:14.201ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
18992025-01-17T08:25:14.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89797 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53298 req_id = d7084b94-7a00-432e-9456-168ed07c2ae7 response_code = 204 uri = /switch-ports
19002025-01-17T08:25:14.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53298 req_id = 644800a4-405f-426c-b253-1878cb71ddd8 response_code = 200 uri = /network-bootstore-config
19012025-01-17T08:25:18.905ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36440
19022025-01-17T08:25:18.905ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36440 req_id = b57b1abf-457c-4a82-ab27-0df273c863c2 response_code = 200 uri = /vpc-routes
19032025-01-17T08:25:18.952ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
19042025-01-17T08:25:18.952ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36440 req_id = b2a8f3bb-8565-45ef-8132-7b61929bed97 response_code = 204 uri = /eip-gateways
19052025-01-17T08:25:18.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 213 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36440 req_id = c42c697a-05b1-42db-b0cd-a7ce36cfec82 response_code = 204 uri = /vpc-routes
19062025-01-17T08:25:19.073ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33394
19072025-01-17T08:25:19.074ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 157 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33394 req_id = 84b263e0-343d-4bc4-95d2-49dfab41bcf2 response_code = 200 uri = /v2p
19082025-01-17T08:25:19.086ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:49808
19092025-01-17T08:25:19.086ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19102025-01-17T08:25:19.123ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19112025-01-17T08:25:19.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92595 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:49808 req_id = a91c36de-7618-42f1-9203-cfe4689c03bb response_code = 204 uri = /switch-ports
19122025-01-17T08:25:19.179ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:49808 req_id = 7f5cb7ea-184b-4538-afc8-2c80063c41be response_code = 200 uri = /network-bootstore-config
19132025-01-17T08:25:23.357ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
19142025-01-17T08:25:23.504ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6123 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = dd4eb424-2c33-47a2-969a-954faedd8558 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
19152025-01-17T08:25:41.195ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:38603
19162025-01-17T08:25:41.195ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 33 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:38603 req_id = 485a42f1-1f34-4b7d-812d-df39fd3cd45a response_code = 200 uri = /baseboard
19172025-01-17T08:25:42.226ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61734
19182025-01-17T08:25:42.226ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 57 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61734 req_id = 2dbfa65b-0eb4-4668-af62-bd523a4d6c8e response_code = 200 uri = /vpc-routes
19192025-01-17T08:25:42.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63965
19202025-01-17T08:25:42.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63965 req_id = 5f262985-b865-4fb8-a041-ec684fa59898 response_code = 200 uri = /v2p
19212025-01-17T08:25:42.270ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
19222025-01-17T08:25:42.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61734 req_id = df189ab5-5611-4b7b-90b9-01d740f84291 response_code = 204 uri = /eip-gateways
19232025-01-17T08:25:42.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61734 req_id = 0a8d7c55-b5ea-46f5-9b4b-df4937e05266 response_code = 204 uri = /vpc-routes
19242025-01-17T08:25:42.341ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57632
19252025-01-17T08:25:42.341ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19262025-01-17T08:25:42.377ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19272025-01-17T08:25:42.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86322 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57632 req_id = cb4d7773-1cbb-4a55-acf5-355b815ae753 response_code = 204 uri = /switch-ports
19282025-01-17T08:25:42.427ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57632 req_id = 773a4dcf-ff05-4238-9251-aedc26a3e953 response_code = 200 uri = /network-bootstore-config
19292025-01-17T08:25:44.014ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44300
19302025-01-17T08:25:44.014ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44300 req_id = 94a7c31f-9ebd-4c23-b6bd-df8fe498d03b response_code = 200 uri = /vpc-routes
19312025-01-17T08:25:44.068ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
19322025-01-17T08:25:44.068ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44300 req_id = 802e457b-f38c-49de-979a-1825016f4d69 response_code = 204 uri = /eip-gateways
19332025-01-17T08:25:44.078ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 280 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44300 req_id = 5e2711c2-c749-4f3f-b316-7383279b9139 response_code = 204 uri = /vpc-routes
19342025-01-17T08:25:44.169ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58795
19352025-01-17T08:25:44.169ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58795 req_id = 38997b04-57a7-45e5-ae93-b17c564ae81c response_code = 200 uri = /v2p
19362025-01-17T08:25:44.260ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:42908
19372025-01-17T08:25:44.260ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19382025-01-17T08:25:44.297ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19392025-01-17T08:25:44.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88514 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:42908 req_id = ccab7705-be35-4fdb-923b-3b86c0bcf93d response_code = 204 uri = /switch-ports
19402025-01-17T08:25:44.349ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:42908 req_id = 60a3228c-565e-4546-b5fa-0ec9b7745574 response_code = 200 uri = /network-bootstore-config
19412025-01-17T08:25:49.054ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61978
19422025-01-17T08:25:49.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61978 req_id = fbdc7de6-0f39-4d47-bd70-cfcaf488fa75 response_code = 200 uri = /vpc-routes
19432025-01-17T08:25:49.106ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
19442025-01-17T08:25:49.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61978 req_id = db5ca151-17f9-48dd-a0ca-e4734ceb339a response_code = 204 uri = /eip-gateways
19452025-01-17T08:25:49.116ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61978 req_id = d2f9c2e0-68b3-4737-947e-be4f12c5074c response_code = 204 uri = /vpc-routes
19462025-01-17T08:25:49.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:35733
19472025-01-17T08:25:49.156ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19482025-01-17T08:25:49.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19492025-01-17T08:25:49.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92357 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:35733 req_id = 92175e01-bfb6-4341-a2c8-0184be3e9c6e response_code = 204 uri = /switch-ports
19502025-01-17T08:25:49.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42697
19512025-01-17T08:25:49.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 166 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42697 req_id = 6a84473e-43d8-4655-91e7-94eadbcc7317 response_code = 200 uri = /v2p
19522025-01-17T08:25:49.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:35733 req_id = 9642ad3b-eace-43d2-9d74-5f29d9e85b67 response_code = 200 uri = /network-bootstore-config
19532025-01-17T08:25:53.504ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6072 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 0e929e04-02da-4c3d-bb34-4f41257c3905 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
19542025-01-17T08:26:11.228ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65350
19552025-01-17T08:26:11.228ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 68 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65350 req_id = bea77bbf-8130-4e19-a03c-6f0586943413 response_code = 200 uri = /baseboard
19562025-01-17T08:26:12.118ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51691
19572025-01-17T08:26:12.118ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51691 req_id = 4eca9eba-399e-437c-91ce-e8920aa2cd2a response_code = 200 uri = /vpc-routes
19582025-01-17T08:26:12.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
19592025-01-17T08:26:12.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 79 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51691 req_id = 3d3f3cb9-99ea-4e18-b29f-efe6b1806f16 response_code = 204 uri = /eip-gateways
19602025-01-17T08:26:12.178ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 226 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:51691 req_id = 66938170-3c19-4cbc-a789-53c1955881ea response_code = 204 uri = /vpc-routes
19612025-01-17T08:26:12.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58136
19622025-01-17T08:26:12.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58136 req_id = d4a03503-f15e-4883-a0f7-ed6c9a5f4b73 response_code = 200 uri = /v2p
19632025-01-17T08:26:12.293ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54766
19642025-01-17T08:26:12.293ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19652025-01-17T08:26:12.329ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19662025-01-17T08:26:12.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89465 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54766 req_id = 3ba5e931-0696-423c-8e0b-4851ee4d9e5d response_code = 204 uri = /switch-ports
19672025-01-17T08:26:12.382ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54766 req_id = a4f532ba-703f-4845-8b87-b2ba867a9d00 response_code = 200 uri = /network-bootstore-config
19682025-01-17T08:26:14.003ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51492
19692025-01-17T08:26:14.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51492 req_id = 59cbd164-69ff-49d1-baf1-0e9ced45419b response_code = 200 uri = /vpc-routes
19702025-01-17T08:26:14.019ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
19712025-01-17T08:26:14.019ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 83 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51492 req_id = ff8aa461-5ad2-41c6-ad76-e874672b453d response_code = 204 uri = /eip-gateways
19722025-01-17T08:26:14.028ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51492 req_id = c0df9394-e70d-418b-b195-e3411a91ff28 response_code = 204 uri = /vpc-routes
19732025-01-17T08:26:14.091ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:49897
19742025-01-17T08:26:14.091ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:49897 req_id = 741a7b86-4b4e-466f-b838-4f6920c9ee28 response_code = 200 uri = /v2p
19752025-01-17T08:26:14.158ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54939
19762025-01-17T08:26:14.158ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19772025-01-17T08:26:14.197ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19782025-01-17T08:26:14.255ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96963 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:54939 req_id = 01e590cb-0b43-4e92-8f20-8722c34b4dcf response_code = 204 uri = /switch-ports
19792025-01-17T08:26:14.256ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 165 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54939 req_id = ce05e5a5-ff49-493d-9991-20c912f04f4c response_code = 200 uri = /network-bootstore-config
19802025-01-17T08:26:18.789ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55414
19812025-01-17T08:26:18.790ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55414 req_id = b534fa38-ba4a-45ff-a9c4-a6fb22106931 response_code = 200 uri = /vpc-routes
19822025-01-17T08:26:18.852ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
19832025-01-17T08:26:18.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55414 req_id = 92a007bd-2c42-4fc1-ad42-586022041393 response_code = 204 uri = /eip-gateways
19842025-01-17T08:26:18.860ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55414 req_id = 3dd1750b-3035-4709-9b4b-b80a50517861 response_code = 204 uri = /vpc-routes
19852025-01-17T08:26:18.886ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:51284
19862025-01-17T08:26:18.886ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
19872025-01-17T08:26:18.926ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
19882025-01-17T08:26:18.993ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106619 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:51284 req_id = 2da2ebfd-7ff6-4ab2-9a3b-136774f3b914 response_code = 204 uri = /switch-ports
19892025-01-17T08:26:18.995ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 85 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:51284 req_id = cb2d554b-e843-4f82-b1b7-7708c175c726 response_code = 200 uri = /network-bootstore-config
19902025-01-17T08:26:19.055ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:32840
19912025-01-17T08:26:19.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 141 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:32840 req_id = a5d4fd79-ebf6-4edb-8ab3-f074c2794bfe response_code = 200 uri = /v2p
19922025-01-17T08:26:23.504ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6251 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 086808be-8747-4c0d-874c-37367ea1fe83 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
19932025-01-17T08:26:41.262ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:46367
19942025-01-17T08:26:41.262ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:46367 req_id = 17e01b93-b482-41bd-a4af-26054e775960 response_code = 200 uri = /baseboard
19952025-01-17T08:26:42.306ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:33950
19962025-01-17T08:26:42.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:33950 req_id = 1d5aef26-f668-4a01-bf85-e917db90f127 response_code = 200 uri = /vpc-routes
19972025-01-17T08:26:42.352ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
19982025-01-17T08:26:42.352ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33950 req_id = 59597cbe-4001-4f18-a440-547e23226863 response_code = 204 uri = /eip-gateways
19992025-01-17T08:26:42.361ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 268 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:33950 req_id = 4423f7f0-6037-4758-a02e-35ec8b5eb6b9 response_code = 204 uri = /vpc-routes
20002025-01-17T08:26:42.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54550
20012025-01-17T08:26:42.435ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54550 req_id = 0bb3171d-2205-4af9-9427-77ba72b17c19 response_code = 200 uri = /v2p
20022025-01-17T08:26:42.482ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35246
20032025-01-17T08:26:42.482ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20042025-01-17T08:26:42.519ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20052025-01-17T08:26:42.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88832 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:35246 req_id = 6ea6ce43-261d-45d5-8b1a-fc93a2fda5a3 response_code = 204 uri = /switch-ports
20062025-01-17T08:26:42.571ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35246 req_id = 0286dc50-67c6-4e6e-973d-02fe34c68a8d response_code = 200 uri = /network-bootstore-config
20072025-01-17T08:26:44.082ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41462
20082025-01-17T08:26:44.082ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41462 req_id = ea351e9b-dccf-44ed-ad57-fb49016baef3 response_code = 200 uri = /vpc-routes
20092025-01-17T08:26:44.096ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
20102025-01-17T08:26:44.096ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41462 req_id = 5def63b4-09f0-4254-b7e8-6df8b363e854 response_code = 204 uri = /eip-gateways
20112025-01-17T08:26:44.363ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62938
20122025-01-17T08:26:44.363ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62938 req_id = a03128b8-476a-4fcd-9d54-326dda31dffa response_code = 200 uri = /v2p
20132025-01-17T08:26:44.367ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 181 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41462 req_id = 1a9b5f29-bb21-4641-b0d8-05c9d561676f response_code = 204 uri = /vpc-routes
20142025-01-17T08:26:44.469ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48994
20152025-01-17T08:26:44.469ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20162025-01-17T08:26:44.506ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20172025-01-17T08:26:44.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93381 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:48994 req_id = 9dc8fd00-e140-447a-8265-fdfedce1ddf2 response_code = 204 uri = /switch-ports
20182025-01-17T08:26:44.563ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48994 req_id = b8428a61-2e83-472a-b330-78903b2c399f response_code = 200 uri = /network-bootstore-config
20192025-01-17T08:26:49.047ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36650
20202025-01-17T08:26:49.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36650 req_id = 58c187d4-5bd3-4596-9568-0d418ac19d39 response_code = 200 uri = /vpc-routes
20212025-01-17T08:26:49.094ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
20222025-01-17T08:26:49.094ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 61 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36650 req_id = b1a0c07f-04ec-4ce0-83e1-bb08f1b2fbc6 response_code = 204 uri = /eip-gateways
20232025-01-17T08:26:49.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36650 req_id = cbce488f-ad41-4b18-b32d-9ce2657ebd07 response_code = 204 uri = /vpc-routes
20242025-01-17T08:26:49.143ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64168
20252025-01-17T08:26:49.143ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20262025-01-17T08:26:49.181ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20272025-01-17T08:26:49.234ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91635 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:64168 req_id = 1da5ac7a-a526-45db-a7aa-33bccd855e2d response_code = 204 uri = /switch-ports
20282025-01-17T08:26:49.234ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55416
20292025-01-17T08:26:49.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55416 req_id = c2a7f20f-fc2d-4880-aa5b-624309879afe response_code = 200 uri = /v2p
20302025-01-17T08:26:49.235ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64168 req_id = 3dc34766-f91d-4c0b-be58-3d5ca2d85a0e response_code = 200 uri = /network-bootstore-config
20312025-01-17T08:26:53.505ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6414 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = a269bbf2-b5f0-47ea-9cb7-a60c1ba8cd7b response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
20322025-01-17T08:27:11.297ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:61010
20332025-01-17T08:27:11.297ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:61010 req_id = bc283726-6c4a-4cc7-a35c-7b0aae2c8d39 response_code = 200 uri = /baseboard
20342025-01-17T08:27:12.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43198
20352025-01-17T08:27:12.011ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43198 req_id = a4ade071-27e4-41c1-93da-f9876cbf7e9d response_code = 200 uri = /vpc-routes
20362025-01-17T08:27:12.072ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
20372025-01-17T08:27:12.072ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43198 req_id = afcbb5da-1c47-4fe5-83ee-dabf36c46ab8 response_code = 204 uri = /eip-gateways
20382025-01-17T08:27:12.083ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 271 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43198 req_id = b9751753-896c-4542-a877-c8157eecaed2 response_code = 204 uri = /vpc-routes
20392025-01-17T08:27:12.144ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42667
20402025-01-17T08:27:12.145ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20412025-01-17T08:27:12.182ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20422025-01-17T08:27:12.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91329 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42667 req_id = 56259e4b-ae72-47e7-ae68-f941e101e6dc response_code = 204 uri = /switch-ports
20432025-01-17T08:27:12.236ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45418
20442025-01-17T08:27:12.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45418 req_id = b028c54a-0b1a-47d4-9ff1-f3eb719c54a9 response_code = 200 uri = /v2p
20452025-01-17T08:27:12.236ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 210 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42667 req_id = 086406e5-8274-4f9a-967e-a9a8fd407e91 response_code = 200 uri = /network-bootstore-config
20462025-01-17T08:27:13.979ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61579
20472025-01-17T08:27:13.979ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61579 req_id = e99de733-97e0-4509-8634-0f95186e87cd response_code = 200 uri = /vpc-routes
20482025-01-17T08:27:14.038ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
20492025-01-17T08:27:14.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61579 req_id = 9bb8fb35-8dd0-4975-bcfa-1dc380f3bf3b response_code = 204 uri = /eip-gateways
20502025-01-17T08:27:14.047ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61579 req_id = cabc802b-0508-416a-8d38-88bc5a498731 response_code = 204 uri = /vpc-routes
20512025-01-17T08:27:14.180ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37040
20522025-01-17T08:27:14.180ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37040 req_id = 0dc3c42f-e93f-4212-ba2f-b4a13bb83062 response_code = 200 uri = /v2p
20532025-01-17T08:27:14.200ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53507
20542025-01-17T08:27:14.200ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20552025-01-17T08:27:14.239ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20562025-01-17T08:27:14.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96529 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:53507 req_id = 2bb5a7af-83aa-457c-b48f-12f527fcd7f6 response_code = 204 uri = /switch-ports
20572025-01-17T08:27:14.297ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53507 req_id = 85f2f9bf-6d9b-4718-8fa2-b4dcd6d10ec2 response_code = 200 uri = /network-bootstore-config
20582025-01-17T08:27:18.992ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41614
20592025-01-17T08:27:18.992ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41614 req_id = 563eb9a8-3852-498d-9572-9e81d0d27dac response_code = 200 uri = /vpc-routes
20602025-01-17T08:27:19.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54757
20612025-01-17T08:27:19.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54757 req_id = bc27cd20-a99f-4e04-9a12-9e6c4066b723 response_code = 200 uri = /v2p
20622025-01-17T08:27:19.037ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
20632025-01-17T08:27:19.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41614 req_id = ce576651-6911-4bc3-a88f-f90f3eb80a0d response_code = 204 uri = /eip-gateways
20642025-01-17T08:27:19.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 162 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:41614 req_id = 71341a58-4d72-4112-9d75-f66caf994d7a response_code = 204 uri = /vpc-routes
20652025-01-17T08:27:19.076ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50823
20662025-01-17T08:27:19.077ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20672025-01-17T08:27:19.117ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20682025-01-17T08:27:19.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95036 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50823 req_id = 0996afac-cb23-4051-9cc2-aca80243e537 response_code = 204 uri = /switch-ports
20692025-01-17T08:27:19.172ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50823 req_id = 083df6e8-b699-41ac-b8e8-a441bd1ca628 response_code = 200 uri = /network-bootstore-config
20702025-01-17T08:27:23.506ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6618 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 461d7ca9-328d-4251-83cd-bfd847d65802 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
20712025-01-17T08:27:41.331ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59759
20722025-01-17T08:27:41.331ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59759 req_id = 4310c18e-5b1f-4ea0-9149-8d527c76dc0b response_code = 200 uri = /baseboard
20732025-01-17T08:27:42.313ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:47944
20742025-01-17T08:27:42.313ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:47944 req_id = c3be79aa-293a-4419-8c70-9ea50e66ed9d response_code = 200 uri = /vpc-routes
20752025-01-17T08:27:42.360ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
20762025-01-17T08:27:42.360ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47944 req_id = 9b002a75-7954-4957-a8e0-3fc753defc66 response_code = 204 uri = /eip-gateways
20772025-01-17T08:27:42.389ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51145
20782025-01-17T08:27:42.390ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 119 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51145 req_id = d6183647-5370-4978-ac90-ffee0827ef29 response_code = 200 uri = /v2p
20792025-01-17T08:27:42.399ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 180 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:47944 req_id = 8cc5ce10-ea55-48fd-b618-1b10cfbb2414 response_code = 204 uri = /vpc-routes
20802025-01-17T08:27:42.544ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39724
20812025-01-17T08:27:42.544ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20822025-01-17T08:27:42.581ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20832025-01-17T08:27:42.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93797 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39724 req_id = bed816be-e89a-4dce-8228-ef342f361aeb response_code = 204 uri = /switch-ports
20842025-01-17T08:27:42.638ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39724 req_id = d7a5106c-96f0-48ff-8649-48d8b77ac66e response_code = 200 uri = /network-bootstore-config
20852025-01-17T08:27:44.219ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54545
20862025-01-17T08:27:44.219ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 73 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54545 req_id = 635fe164-9af7-4644-9fee-73b568b8b984 response_code = 200 uri = /vpc-routes
20872025-01-17T08:27:44.240ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57717
20882025-01-17T08:27:44.240ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 111 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57717 req_id = b002432c-196d-4ca7-9645-a24e90810cf9 response_code = 200 uri = /v2p
20892025-01-17T08:27:44.263ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
20902025-01-17T08:27:44.263ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54545 req_id = e0f0cd1f-2eb4-4918-851b-746436142a7b response_code = 204 uri = /eip-gateways
20912025-01-17T08:27:44.272ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:54545 req_id = d0603ce0-69cd-42e1-88f9-1798668af8d3 response_code = 204 uri = /vpc-routes
20922025-01-17T08:27:44.333ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35082
20932025-01-17T08:27:44.333ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
20942025-01-17T08:27:44.371ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
20952025-01-17T08:27:44.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92889 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35082 req_id = 4be17118-68b4-4269-bfee-f1875a1af6b8 response_code = 204 uri = /switch-ports
20962025-01-17T08:27:44.426ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35082 req_id = f8eb9ecc-a2f1-40d6-b6f9-56d141d49f4d response_code = 200 uri = /network-bootstore-config
20972025-01-17T08:27:48.866ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47262
20982025-01-17T08:27:48.867ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 58 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47262 req_id = 34bd2dc8-5b21-4b2f-9239-ee1f8c81102e response_code = 200 uri = /vpc-routes
20992025-01-17T08:27:48.918ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
21002025-01-17T08:27:48.918ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47262 req_id = fd885956-7ed3-4c6c-8a69-bd7e5a8caf8b response_code = 204 uri = /eip-gateways
21012025-01-17T08:27:48.928ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 199 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47262 req_id = 0a94fc79-b3d4-46cc-bd39-ea1cce14fca6 response_code = 204 uri = /vpc-routes
21022025-01-17T08:27:49.026ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42174
21032025-01-17T08:27:49.026ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42174 req_id = 6a3c935c-512e-4460-9eb9-2721a61724b0 response_code = 200 uri = /v2p
21042025-01-17T08:27:49.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54399
21052025-01-17T08:27:49.138ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21062025-01-17T08:27:49.177ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21072025-01-17T08:27:49.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93162 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:54399 req_id = ec6bce10-ecc0-4a8b-9fae-7b7d9d89d28f response_code = 204 uri = /switch-ports
21082025-01-17T08:27:49.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54399 req_id = 5d8daf0b-9e52-40a9-b54f-b1967dd7e447 response_code = 200 uri = /network-bootstore-config
21092025-01-17T08:27:53.506ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6764 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = c0c24f19-655f-4683-a696-93aeb8047f7b response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21102025-01-17T08:28:11.364ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49232
21112025-01-17T08:28:11.364ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49232 req_id = 2ed1ada2-9f74-42c0-836d-87ff32ae0274 response_code = 200 uri = /baseboard
21122025-01-17T08:28:12.104ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55107
21132025-01-17T08:28:12.105ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55107 req_id = bb0ee29d-df3b-4cdb-8cea-2c1630a79ae8 response_code = 200 uri = /vpc-routes
21142025-01-17T08:28:12.120ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
21152025-01-17T08:28:12.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 66 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55107 req_id = 8ad7fd82-ebc6-4d7c-9d40-6f9db7bd675f response_code = 204 uri = /eip-gateways
21162025-01-17T08:28:12.129ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 218 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:55107 req_id = 0e499ec1-3c90-44e1-95f7-41c803e9e9c0 response_code = 204 uri = /vpc-routes
21172025-01-17T08:28:12.152ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41681
21182025-01-17T08:28:12.152ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41681 req_id = 122de2c6-26d3-4300-be11-3101377f8d5d response_code = 200 uri = /v2p
21192025-01-17T08:28:12.210ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:65196
21202025-01-17T08:28:12.210ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21212025-01-17T08:28:12.250ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21222025-01-17T08:28:12.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:65196 req_id = e28def04-6651-4b54-a954-46d9f1223eb4 response_code = 204 uri = /switch-ports
21232025-01-17T08:28:12.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:65196 req_id = 745b89c9-c524-4929-acf7-2e5ae5ee67a8 response_code = 200 uri = /network-bootstore-config
21242025-01-17T08:28:14.030ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44707
21252025-01-17T08:28:14.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44707 req_id = e20e578e-253f-4f41-8575-963b1052e3ee response_code = 200 uri = /vpc-routes
21262025-01-17T08:28:14.092ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
21272025-01-17T08:28:14.092ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44707 req_id = f699c09c-1d56-4e30-b3cd-7fb825bc7c87 response_code = 204 uri = /eip-gateways
21282025-01-17T08:28:14.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44707 req_id = ac1524d5-1b5d-45d3-a210-b644016ed09f response_code = 204 uri = /vpc-routes
21292025-01-17T08:28:14.149ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37508
21302025-01-17T08:28:14.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37508 req_id = 5d17b5f3-a427-40b8-989e-066f83d95a69 response_code = 200 uri = /v2p
21312025-01-17T08:28:14.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:57695
21322025-01-17T08:28:14.156ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21332025-01-17T08:28:14.194ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21342025-01-17T08:28:14.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92539 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:57695 req_id = 4875af4e-5454-44f0-83d5-34e38287d6ac response_code = 204 uri = /switch-ports
21352025-01-17T08:28:14.249ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:57695 req_id = 0d283bc4-3d8a-4762-b64d-adbed417e5bf response_code = 200 uri = /network-bootstore-config
21362025-01-17T08:28:18.810ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:64371
21372025-01-17T08:28:18.810ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:64371 req_id = 012af45f-6711-47a1-9b14-f7f3a62c5081 response_code = 200 uri = /vpc-routes
21382025-01-17T08:28:18.851ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
21392025-01-17T08:28:18.852ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64371 req_id = 368fc70a-6ceb-4af7-89ad-cb0df5a58c9d response_code = 204 uri = /eip-gateways
21402025-01-17T08:28:18.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:64371 req_id = 918e7d6a-ecf3-4e81-a7b4-bf0fc947574a response_code = 204 uri = /vpc-routes
21412025-01-17T08:28:18.895ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:38477
21422025-01-17T08:28:18.895ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21432025-01-17T08:28:18.935ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21442025-01-17T08:28:18.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94642 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:38477 req_id = 73bf403d-2a39-4871-a381-ac55ac69f120 response_code = 204 uri = /switch-ports
21452025-01-17T08:28:18.990ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39991
21462025-01-17T08:28:18.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 202 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39991 req_id = 0a06d672-f0e9-41a9-9dd7-69516c2cb513 response_code = 200 uri = /v2p
21472025-01-17T08:28:18.990ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 232 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:38477 req_id = 6aac51af-cf6a-4c62-adc0-e20e5f805846 response_code = 200 uri = /network-bootstore-config
21482025-01-17T08:28:23.506ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6113 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = cc1b877f-0f49-4f9e-be5c-954041d25921 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
21492025-01-17T08:28:41.396ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45200
21502025-01-17T08:28:41.396ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45200 req_id = dfd3a61b-1ff1-45e9-b28a-99043a03ad44 response_code = 200 uri = /baseboard
21512025-01-17T08:28:42.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55426
21522025-01-17T08:28:42.271ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 130 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55426 req_id = 7042cc6c-0805-4b2a-baa8-9e5dd1f70268 response_code = 200 uri = /v2p
21532025-01-17T08:28:42.338ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40094
21542025-01-17T08:28:42.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40094 req_id = 47b4c091-3267-4c2f-9cc0-c52fa8a58fed response_code = 200 uri = /vpc-routes
21552025-01-17T08:28:42.383ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
21562025-01-17T08:28:42.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40094 req_id = 762c6e67-4bb8-4f33-a7ce-1a2bd547d9e3 response_code = 204 uri = /eip-gateways
21572025-01-17T08:28:42.391ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40094 req_id = f03ad4b2-de56-4375-b311-bf6c77eb2393 response_code = 204 uri = /vpc-routes
21582025-01-17T08:28:42.448ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42766
21592025-01-17T08:28:42.448ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21602025-01-17T08:28:42.487ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21612025-01-17T08:28:42.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95215 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:42766 req_id = 99055023-c927-4f0a-887e-59644a509c17 response_code = 204 uri = /switch-ports
21622025-01-17T08:28:42.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43090
21632025-01-17T08:28:42.543ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21642025-01-17T08:28:42.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 263 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42766 req_id = 7bd89a13-1bc3-4f34-97d3-a62c4ffbc0d0 response_code = 200 uri = /network-bootstore-config
21652025-01-17T08:28:42.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21662025-01-17T08:28:42.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21672025-01-17T08:28:42.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21682025-01-17T08:28:42.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21692025-01-17T08:28:42.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21702025-01-17T08:28:42.544ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21712025-01-17T08:28:42.544ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 497 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43090 req_id = d52b36cd-a618-4fff-b335-361ec278cdcc response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21722025-01-17T08:28:44.117ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51712
21732025-01-17T08:28:44.117ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51712 req_id = 65c43d06-4553-42bd-be76-9ef8865e0096 response_code = 200 uri = /vpc-routes
21742025-01-17T08:28:44.167ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
21752025-01-17T08:28:44.167ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51712 req_id = d85f7ab4-da2c-4d28-a007-57e6db81ba6e response_code = 204 uri = /eip-gateways
21762025-01-17T08:28:44.175ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 188 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51712 req_id = 87f76ff0-9815-4e59-a378-36411fa5757f response_code = 204 uri = /vpc-routes
21772025-01-17T08:28:44.238ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63975
21782025-01-17T08:28:44.238ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 129 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63975 req_id = fb9f4b42-a99c-4f84-a21d-d60ef57d3057 response_code = 200 uri = /v2p
21792025-01-17T08:28:44.255ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43559
21802025-01-17T08:28:44.255ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
21812025-01-17T08:28:44.294ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
21822025-01-17T08:28:44.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100082 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43559 req_id = 370b4468-147d-4d10-984c-283f553efaf1 response_code = 204 uri = /switch-ports
21832025-01-17T08:28:44.355ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43559 req_id = 4853fb09-84d5-4120-b4a2-2d66fce6a196 response_code = 200 uri = /network-bootstore-config
21842025-01-17T08:28:44.451ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35683
21852025-01-17T08:28:44.451ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
21862025-01-17T08:28:44.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21872025-01-17T08:28:44.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21882025-01-17T08:28:44.451ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
21892025-01-17T08:28:44.452ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21902025-01-17T08:28:44.452ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
21912025-01-17T08:28:44.452ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
21922025-01-17T08:28:44.452ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 325 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35683 req_id = 655cf985-d20c-478b-a21f-3bfb3f902513 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
21932025-01-17T08:28:49.151ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46510
21942025-01-17T08:28:49.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 54 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46510 req_id = b1ef053c-4b43-47af-9c13-88804137c574 response_code = 200 uri = /vpc-routes
21952025-01-17T08:28:49.195ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
21962025-01-17T08:28:49.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46510 req_id = e9264a4d-b41f-491a-861f-96ee7a888945 response_code = 204 uri = /eip-gateways
21972025-01-17T08:28:49.206ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 195 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46510 req_id = b7343f1b-418c-43f1-b81e-138958097cb0 response_code = 204 uri = /vpc-routes
21982025-01-17T08:28:49.225ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:65401
21992025-01-17T08:28:49.225ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22002025-01-17T08:28:49.266ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22012025-01-17T08:28:49.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98255 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:65401 req_id = ae171a4e-b0c5-47f5-b643-07729a06a42d response_code = 204 uri = /switch-ports
22022025-01-17T08:28:49.324ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36371
22032025-01-17T08:28:49.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36371 req_id = c1738269-eafd-4450-8513-e1c67c5b4241 response_code = 200 uri = /v2p
22042025-01-17T08:28:49.324ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 220 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:65401 req_id = 10ec4fbd-4770-4eb4-a918-8bb6ae6e923b response_code = 200 uri = /network-bootstore-config
22052025-01-17T08:28:49.353ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:59140
22062025-01-17T08:28:49.353ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
22072025-01-17T08:28:49.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22082025-01-17T08:28:49.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22092025-01-17T08:28:49.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
22102025-01-17T08:28:49.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22112025-01-17T08:28:49.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
22122025-01-17T08:28:49.353ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
22132025-01-17T08:28:49.353ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 392 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:59140 req_id = 4c4131bc-54ef-4af6-b6ca-ed74d6a33dde response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22142025-01-17T08:28:53.506ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6230 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 093b8148-3596-476a-b187-6299e7c28ea0 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22152025-01-17T08:29:11.430ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:45816
22162025-01-17T08:29:11.430ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:45816 req_id = ec36ecc0-f2b7-4c06-be45-04c7c8ea3915 response_code = 200 uri = /baseboard
22172025-01-17T08:29:12.081ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64254
22182025-01-17T08:29:12.081ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64254 req_id = 35e571bd-84a0-455e-a0e1-1ece2c610e82 response_code = 200 uri = /vpc-routes
22192025-01-17T08:29:12.131ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
22202025-01-17T08:29:12.131ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64254 req_id = b8dad60b-4179-498e-b0ce-f1b7dc9f9574 response_code = 204 uri = /eip-gateways
22212025-01-17T08:29:12.140ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64254 req_id = 452cf9f8-9d14-4320-b8a8-daa0e29c53e0 response_code = 204 uri = /vpc-routes
22222025-01-17T08:29:12.150ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51336
22232025-01-17T08:29:12.151ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 104 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51336 req_id = 3caeb919-73fa-4036-a434-12830cd76474 response_code = 200 uri = /v2p
22242025-01-17T08:29:12.181ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:54943
22252025-01-17T08:29:12.181ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22262025-01-17T08:29:12.218ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22272025-01-17T08:29:12.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88757 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:54943 req_id = cdfbb76d-5acb-4b73-9663-9bde3e8de0e3 response_code = 204 uri = /switch-ports
22282025-01-17T08:29:12.270ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:54943 req_id = 068da112-3c63-4c65-ba0a-7c1a90a9b4dd response_code = 200 uri = /network-bootstore-config
22292025-01-17T08:29:14.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56288
22302025-01-17T08:29:14.036ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56288 req_id = ba73af83-bcd2-4986-88b4-fbd84186583b response_code = 200 uri = /vpc-routes
22312025-01-17T08:29:14.080ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
22322025-01-17T08:29:14.080ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56288 req_id = 31d04ef9-324c-415e-ad05-26b21a4ae400 response_code = 204 uri = /eip-gateways
22332025-01-17T08:29:14.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 219 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:56288 req_id = 65d08543-cfb2-4976-8911-7a9cc3944b2d response_code = 204 uri = /vpc-routes
22342025-01-17T08:29:14.123ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54399
22352025-01-17T08:29:14.123ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54399 req_id = 2678949c-541d-47c5-9cac-ac082beb8757 response_code = 200 uri = /v2p
22362025-01-17T08:29:14.125ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:38145
22372025-01-17T08:29:14.125ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22382025-01-17T08:29:14.162ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22392025-01-17T08:29:14.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87904 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:38145 req_id = 21d3ef66-32bf-40a8-a2fd-ee75dc1882a3 response_code = 204 uri = /switch-ports
22402025-01-17T08:29:14.213ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:38145 req_id = b4faf4aa-8104-4656-9b47-21bdb482b653 response_code = 200 uri = /network-bootstore-config
22412025-01-17T08:29:18.805ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61780
22422025-01-17T08:29:18.805ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61780 req_id = 5d6f7faf-9cc8-4560-a4b5-e91ba75d9979 response_code = 200 uri = /vpc-routes
22432025-01-17T08:29:18.849ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
22442025-01-17T08:29:18.849ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61780 req_id = 5a9549d5-579d-46f0-8e59-92eaefc6bd42 response_code = 204 uri = /eip-gateways
22452025-01-17T08:29:18.887ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:39288
22462025-01-17T08:29:18.887ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:39288 req_id = 993ccc38-6a13-469a-b612-bf30cfd379e9 response_code = 200 uri = /v2p
22472025-01-17T08:29:18.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 171 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:61780 req_id = f6825812-b14d-4d49-aa42-ce92253f7af8 response_code = 204 uri = /vpc-routes
22482025-01-17T08:29:19.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58464
22492025-01-17T08:29:19.038ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22502025-01-17T08:29:19.079ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22512025-01-17T08:29:19.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95230 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:58464 req_id = 3912f18f-084b-4602-88fe-8866d8eec283 response_code = 204 uri = /switch-ports
22522025-01-17T08:29:19.133ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 156 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58464 req_id = fbda1a72-e1a8-4e79-866a-eb193d4ae345 response_code = 200 uri = /network-bootstore-config
22532025-01-17T08:29:23.507ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7441 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 5e486a98-784d-488b-b57c-746529011211 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22542025-01-17T08:29:41.465ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:60928
22552025-01-17T08:29:41.465ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:60928 req_id = 92cf1b58-de91-4f19-b161-e8ada29a45bb response_code = 200 uri = /baseboard
22562025-01-17T08:29:42.089ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:50050
22572025-01-17T08:29:42.089ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:50050 req_id = babb733b-955b-4aac-8fb2-c9659bc3e96f response_code = 200 uri = /vpc-routes
22582025-01-17T08:29:42.119ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
22592025-01-17T08:29:42.119ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50050 req_id = 06fc405a-d6f3-47b3-8733-80ce14ce2c79 response_code = 204 uri = /eip-gateways
22602025-01-17T08:29:42.132ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:50050 req_id = 79bca3ab-f41d-4400-a24d-cf9545b7e7ac response_code = 204 uri = /vpc-routes
22612025-01-17T08:29:42.346ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:55797
22622025-01-17T08:29:42.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:55797 req_id = bca78df6-13a0-42de-a23a-c87d57a93032 response_code = 200 uri = /v2p
22632025-01-17T08:29:42.590ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52188
22642025-01-17T08:29:42.590ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22652025-01-17T08:29:42.628ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22662025-01-17T08:29:42.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94729 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:52188 req_id = edecc8f9-1af0-4c20-8937-8d03b0c0e8c1 response_code = 204 uri = /switch-ports
22672025-01-17T08:29:42.685ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 133 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52188 req_id = 598825e7-2884-4395-adb2-cc243e85cfed response_code = 200 uri = /network-bootstore-config
22682025-01-17T08:29:44.249ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:46379
22692025-01-17T08:29:44.250ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:46379 req_id = 4e05214c-6a4c-4e37-b2a8-f0ec3af8976d response_code = 200 uri = /vpc-routes
22702025-01-17T08:29:44.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62795
22712025-01-17T08:29:44.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 149 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62795 req_id = 272ba40f-2abd-49c2-b585-fbfc66563631 response_code = 200 uri = /v2p
22722025-01-17T08:29:44.291ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
22732025-01-17T08:29:44.291ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46379 req_id = 0672bc26-aaf0-4f12-872f-d9c478786034 response_code = 204 uri = /eip-gateways
22742025-01-17T08:29:44.300ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:46379 req_id = 9f2eb772-f4a8-478e-b726-3701df64fbe1 response_code = 204 uri = /vpc-routes
22752025-01-17T08:29:44.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35526
22762025-01-17T08:29:44.378ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22772025-01-17T08:29:44.413ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22782025-01-17T08:29:44.466ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88791 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:35526 req_id = d1f46a36-228d-4e4e-b563-367ccc4e2ef6 response_code = 204 uri = /switch-ports
22792025-01-17T08:29:44.467ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 109 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35526 req_id = 6b23bfa3-5055-4215-b59d-dbe2505cea0c response_code = 200 uri = /network-bootstore-config
22802025-01-17T08:29:48.929ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63216
22812025-01-17T08:29:48.929ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 121 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63216 req_id = 57448bcc-65fa-4cb5-8cf4-b5f89fd2352b response_code = 200 uri = /vpc-routes
22822025-01-17T08:29:49.003ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
22832025-01-17T08:29:49.003ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63216 req_id = e59d6b56-51ff-430e-ab54-9fa9357578b7 response_code = 204 uri = /eip-gateways
22842025-01-17T08:29:49.013ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 221 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:63216 req_id = 637743bb-9464-4000-899f-cf8bb5f93505 response_code = 204 uri = /vpc-routes
22852025-01-17T08:29:49.102ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:58275
22862025-01-17T08:29:49.102ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 120 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:58275 req_id = 2547dbc1-6bd3-49b0-9a60-1eab7a54017e response_code = 200 uri = /v2p
22872025-01-17T08:29:49.172ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47177
22882025-01-17T08:29:49.172ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
22892025-01-17T08:29:49.210ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
22902025-01-17T08:29:49.266ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93892 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:47177 req_id = feab61e4-3e99-4efb-ab4f-255fefb79702 response_code = 204 uri = /switch-ports
22912025-01-17T08:29:49.267ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:47177 req_id = 2d9a4579-2ff6-4bce-a8ab-1e2558556331 response_code = 200 uri = /network-bootstore-config
22922025-01-17T08:29:53.506ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5886 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = ef3bbec5-59ef-4333-858c-b0cbfa2c07cd response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
22932025-01-17T08:30:09.336ZINFOSledAgent (auto-cleanup-task): running automatic periodic zone bundle cleanup file = sled-agent/src/zone_bundle.rs:197
22942025-01-17T08:30:09.336ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
22952025-01-17T08:30:09.364ZINFOSledAgent (auto-cleanup-task): top of bundle cleanup loop file = sled-agent/src/zone_bundle.rs:186 next_cleanup = Instant { tv_sec: 2318, tv_nsec: 540688900 } time_to_next_cleanup = 599.99999591s
22962025-01-17T08:30:11.499ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32800
22972025-01-17T08:30:11.499ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32800 req_id = ce95871c-bcf0-4cf3-b029-55919ae3da40 response_code = 200 uri = /baseboard
22982025-01-17T08:30:12.103ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:62588
22992025-01-17T08:30:12.103ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:62588 req_id = 8418934b-0326-4a66-adb1-c232cae1da6e response_code = 200 uri = /vpc-routes
23002025-01-17T08:30:12.145ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
23012025-01-17T08:30:12.145ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62588 req_id = 60c76eee-4029-4db9-8c07-98df2f8f1a7f response_code = 204 uri = /eip-gateways
23022025-01-17T08:30:12.157ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 182 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:62588 req_id = c03686cf-3b13-4dd2-a9e7-2b18ff9eb654 response_code = 204 uri = /vpc-routes
23032025-01-17T08:30:12.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64298
23042025-01-17T08:30:12.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64298 req_id = 63904dd0-9cbd-4a11-8b34-775ba35d6cca response_code = 200 uri = /v2p
23052025-01-17T08:30:12.207ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36813
23062025-01-17T08:30:12.207ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23072025-01-17T08:30:12.245ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23082025-01-17T08:30:12.303ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96569 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:36813 req_id = a5795b58-f574-4116-8f8e-1d0167ef3f58 response_code = 204 uri = /switch-ports
23092025-01-17T08:30:12.304ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36813 req_id = 551650eb-e140-4d13-b428-7899446d2444 response_code = 200 uri = /network-bootstore-config
23102025-01-17T08:30:14.070ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:59347
23112025-01-17T08:30:14.070ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:59347 req_id = b03f56cb-4a32-421f-b40b-4e307e4ccfa4 response_code = 200 uri = /vpc-routes
23122025-01-17T08:30:14.115ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
23132025-01-17T08:30:14.115ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59347 req_id = 2a19670a-3c21-4681-9839-d7f0db2fa34d response_code = 204 uri = /eip-gateways
23142025-01-17T08:30:14.127ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:59347 req_id = 3ef40418-2d5b-4c2f-8c3b-6d2def56c021 response_code = 204 uri = /vpc-routes
23152025-01-17T08:30:14.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64782
23162025-01-17T08:30:14.154ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23172025-01-17T08:30:14.191ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23182025-01-17T08:30:14.246ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92351 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:64782 req_id = 3293663e-ff1f-4fff-8cf5-9a8eb03b5066 response_code = 204 uri = /switch-ports
23192025-01-17T08:30:14.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63883
23202025-01-17T08:30:14.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 185 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:63883 req_id = 4c846e92-14fd-4b70-8d79-cde07bdcf691 response_code = 200 uri = /v2p
23212025-01-17T08:30:14.247ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 192 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64782 req_id = 3e4a4db2-3fcd-4f0c-b211-89833c6716e7 response_code = 200 uri = /network-bootstore-config
23222025-01-17T08:30:18.862ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33787
23232025-01-17T08:30:18.862ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33787 req_id = bb485393-d8a3-45c6-b19c-e862e8bcadb5 response_code = 200 uri = /vpc-routes
23242025-01-17T08:30:18.919ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
23252025-01-17T08:30:18.919ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33787 req_id = bcdbdace-ccb6-43b0-bec3-1989f4558c34 response_code = 204 uri = /eip-gateways
23262025-01-17T08:30:18.934ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 247 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33787 req_id = 5b9856ae-4a8d-4af5-af10-a0c54d0936b7 response_code = 204 uri = /vpc-routes
23272025-01-17T08:30:19.011ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57398
23282025-01-17T08:30:19.011ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23292025-01-17T08:30:19.051ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23302025-01-17T08:30:19.108ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97504 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:57398 req_id = 3c5574ac-52b6-4f64-80aa-6f48becb2087 response_code = 204 uri = /switch-ports
23312025-01-17T08:30:19.108ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63622
23322025-01-17T08:30:19.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57398 req_id = a21ac9ba-79c8-4160-ba9f-9aa4a0c9cace response_code = 200 uri = /network-bootstore-config
23332025-01-17T08:30:19.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63622 req_id = d266b85b-9c7c-4f1f-a303-8b7a176dc520 response_code = 200 uri = /v2p
23342025-01-17T08:30:23.361ZINFOSledAgent (DumpSetup-worker): No archival destination for crash dumps yet chosen. file = sled-agent/src/dump_setup.rs:862
23352025-01-17T08:30:23.507ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5872 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 75b620c1-751d-4c10-9c68-0c606a1891b9 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
23362025-01-17T08:30:41.531ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:59621
23372025-01-17T08:30:41.532ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:59621 req_id = b44ef87d-004b-4db1-976c-3c4a177d125c response_code = 200 uri = /baseboard
23382025-01-17T08:30:42.155ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:38403
23392025-01-17T08:30:42.155ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 51 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:38403 req_id = 72774271-75aa-4511-a4ca-b8ee57553d40 response_code = 200 uri = /vpc-routes
23402025-01-17T08:30:42.201ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
23412025-01-17T08:30:42.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 70 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38403 req_id = 8da711a3-5cf1-48aa-b071-4a51af4139bd response_code = 204 uri = /eip-gateways
23422025-01-17T08:30:42.216ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 306 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:38403 req_id = bddce088-948a-41af-b1fa-1d972dce02f4 response_code = 204 uri = /vpc-routes
23432025-01-17T08:30:42.337ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34561
23442025-01-17T08:30:42.338ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 137 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34561 req_id = 51960bbb-6bb8-4f06-ae4e-b009c1ee2e91 response_code = 200 uri = /v2p
23452025-01-17T08:30:42.380ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56784
23462025-01-17T08:30:42.380ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23472025-01-17T08:30:42.416ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23482025-01-17T08:30:42.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93066 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56784 req_id = ab118bbf-1be5-490c-802a-7b90871d7fd7 response_code = 204 uri = /switch-ports
23492025-01-17T08:30:42.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56784 req_id = 98ba9b6d-9ff1-403c-9235-57b4139e3699 response_code = 200 uri = /network-bootstore-config
23502025-01-17T08:30:44.120ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36417
23512025-01-17T08:30:44.120ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 86 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36417 req_id = f7d7380d-41d2-48ff-b814-58cfcb4d1c7f response_code = 200 uri = /vpc-routes
23522025-01-17T08:30:44.136ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
23532025-01-17T08:30:44.136ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36417 req_id = 8f3e3bd3-3140-46af-b3f3-4dc547eda84b response_code = 204 uri = /eip-gateways
23542025-01-17T08:30:44.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:36417 req_id = 59889c9e-3b07-49f0-8ebc-dd71427e7fcf response_code = 204 uri = /vpc-routes
23552025-01-17T08:30:44.325ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:48565
23562025-01-17T08:30:44.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 124 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:48565 req_id = 7671c0b5-6109-4e6a-a83c-c257a5f920ea response_code = 200 uri = /v2p
23572025-01-17T08:30:44.387ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61986
23582025-01-17T08:30:44.388ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23592025-01-17T08:30:44.425ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23602025-01-17T08:30:44.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93424 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:61986 req_id = 6e766c3b-7dd8-43eb-8fdf-c7baa7ecdebd response_code = 204 uri = /switch-ports
23612025-01-17T08:30:44.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61986 req_id = 734ebc2b-4075-4672-8146-39d7044ae139 response_code = 200 uri = /network-bootstore-config
23622025-01-17T08:30:49.098ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46742
23632025-01-17T08:30:49.098ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46742 req_id = 672f5ff8-cfc0-4c32-bd25-8249af4c0d7a response_code = 200 uri = /vpc-routes
23642025-01-17T08:30:49.134ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55975
23652025-01-17T08:30:49.134ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55975 req_id = 08bbbb3b-a130-43bc-83e9-10ef6cbc931b response_code = 200 uri = /v2p
23662025-01-17T08:30:49.139ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
23672025-01-17T08:30:49.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46742 req_id = 15168d70-4930-4825-bb73-7c438871f702 response_code = 204 uri = /eip-gateways
23682025-01-17T08:30:49.148ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 154 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:46742 req_id = c0f39cb4-8af4-4326-8dca-f30da09c4663 response_code = 204 uri = /vpc-routes
23692025-01-17T08:30:49.230ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63440
23702025-01-17T08:30:49.230ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23712025-01-17T08:30:49.270ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23722025-01-17T08:30:49.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94899 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63440 req_id = b4aeb575-89ee-41fd-904b-3424676a7a44 response_code = 204 uri = /switch-ports
23732025-01-17T08:30:49.325ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63440 req_id = 41849de9-6d27-4c18-8a69-05a48fabedc4 response_code = 200 uri = /network-bootstore-config
23742025-01-17T08:30:53.506ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 5873 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 4b993a42-f437-469c-931b-166505cb5608 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
23752025-01-17T08:31:11.564ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:48459
23762025-01-17T08:31:11.564ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 41 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:48459 req_id = ebd03951-c4ab-49d6-a80f-48c10139ec4c response_code = 200 uri = /baseboard
23772025-01-17T08:31:12.029ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:61696
23782025-01-17T08:31:12.029ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:61696 req_id = 486044ae-7a77-49fb-a759-57eb24a58b51 response_code = 200 uri = /vpc-routes
23792025-01-17T08:31:12.088ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
23802025-01-17T08:31:12.088ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 59 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61696 req_id = e10724ac-2362-4a9c-8d65-2886d93f1a1c response_code = 204 uri = /eip-gateways
23812025-01-17T08:31:12.097ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 143 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:61696 req_id = 3b706f0a-bc18-4dd8-94db-0a506dca0308 response_code = 204 uri = /vpc-routes
23822025-01-17T08:31:12.139ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:34936
23832025-01-17T08:31:12.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:34936 req_id = 8bc4247f-4452-470e-a10f-0d0c324a1d1b response_code = 200 uri = /v2p
23842025-01-17T08:31:12.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39820
23852025-01-17T08:31:12.190ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23862025-01-17T08:31:12.226ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23872025-01-17T08:31:12.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91812 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:39820 req_id = 4e42fa05-370a-41cd-8570-3015261006f1 response_code = 204 uri = /switch-ports
23882025-01-17T08:31:12.282ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39820 req_id = 09bc45e7-220f-4c0e-88d7-c5aab6ae7b56 response_code = 200 uri = /network-bootstore-config
23892025-01-17T08:31:14.024ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:62922
23902025-01-17T08:31:14.024ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:62922 req_id = 50f73ac4-e665-4549-b3cf-657b9bb6d5b2 response_code = 200 uri = /vpc-routes
23912025-01-17T08:31:14.077ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
23922025-01-17T08:31:14.077ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 84 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62922 req_id = 46f3eaa0-97f2-47a7-b679-b9b8e1bfe500 response_code = 204 uri = /eip-gateways
23932025-01-17T08:31:14.124ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:36598
23942025-01-17T08:31:14.124ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 125 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:36598 req_id = f8c15ead-73a0-4b6a-a801-ddf9d7dcdd7a response_code = 200 uri = /v2p
23952025-01-17T08:31:14.130ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 242 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:62922 req_id = c29d2092-452a-437e-9691-2f2b3ae697b6 response_code = 204 uri = /vpc-routes
23962025-01-17T08:31:14.223ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39644
23972025-01-17T08:31:14.223ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
23982025-01-17T08:31:14.264ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
23992025-01-17T08:31:14.322ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98994 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39644 req_id = dcc5f0dc-45b8-4e9e-996d-ff69c11cf951 response_code = 204 uri = /switch-ports
24002025-01-17T08:31:14.323ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39644 req_id = 0b23571e-4bcc-4bf2-9f15-3bd30f4b8eb2 response_code = 200 uri = /network-bootstore-config
24012025-01-17T08:31:18.888ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:34414
24022025-01-17T08:31:18.888ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:34414 req_id = 0bf2d04b-9446-42c3-be2c-de6511a82f51 response_code = 200 uri = /vpc-routes
24032025-01-17T08:31:18.921ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57321
24042025-01-17T08:31:18.921ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 115 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57321 req_id = 0750ecf9-612a-46f8-86ea-4c21a4c8f0d8 response_code = 200 uri = /v2p
24052025-01-17T08:31:18.930ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
24062025-01-17T08:31:18.930ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 56 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34414 req_id = f15c2148-d235-45b0-af56-86bfceefa38a response_code = 204 uri = /eip-gateways
24072025-01-17T08:31:18.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 173 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:34414 req_id = 32a8af6a-056e-40c2-bb02-32cbabb50067 response_code = 204 uri = /vpc-routes
24082025-01-17T08:31:19.008ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56646
24092025-01-17T08:31:19.008ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24102025-01-17T08:31:19.045ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24112025-01-17T08:31:19.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92746 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:56646 req_id = ad2dade6-279d-4221-8b20-e582f7373998 response_code = 204 uri = /switch-ports
24122025-01-17T08:31:19.101ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56646 req_id = d4e60655-7409-4dc6-b4e4-c4bd78716ad9 response_code = 200 uri = /network-bootstore-config
24132025-01-17T08:31:23.507ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6027 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = a4c9e282-7bb4-4927-8c1e-fda42a78e2bd response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
24142025-01-17T08:31:41.595ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:52014
24152025-01-17T08:31:41.596ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 60 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:52014 req_id = adb31db3-1698-4293-98e7-46fef9acbfca response_code = 200 uri = /baseboard
24162025-01-17T08:31:42.154ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45135
24172025-01-17T08:31:42.154ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45135 req_id = f72a1784-6e91-4d66-b4fb-19d7070bddde response_code = 200 uri = /vpc-routes
24182025-01-17T08:31:42.239ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
24192025-01-17T08:31:42.239ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 158 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45135 req_id = 2b188a9c-b70a-4965-88fe-7525f5d026ac response_code = 204 uri = /eip-gateways
24202025-01-17T08:31:42.248ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 255 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:45135 req_id = 395fb604-667f-4452-b3c9-3bb01c3d5232 response_code = 204 uri = /vpc-routes
24212025-01-17T08:31:42.412ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35112
24222025-01-17T08:31:42.412ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35112 req_id = cf304196-bf52-4413-af26-beff7f0ead58 response_code = 200 uri = /v2p
24232025-01-17T08:31:42.418ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40928
24242025-01-17T08:31:42.418ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24252025-01-17T08:31:42.454ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24262025-01-17T08:31:42.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87396 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:40928 req_id = 9e1d5c3c-de47-4ef1-9b35-7ee29a16ea1e response_code = 204 uri = /switch-ports
24272025-01-17T08:31:42.506ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40928 req_id = fcdbb8d4-5d59-4c17-a615-23ff7d956886 response_code = 200 uri = /network-bootstore-config
24282025-01-17T08:31:44.106ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:34992
24292025-01-17T08:31:44.106ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 184 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:34992 req_id = ae3133de-3e5c-4b77-ab2d-635d04a53eb2 response_code = 200 uri = /v2p
24302025-01-17T08:31:44.142ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61185
24312025-01-17T08:31:44.142ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 43 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:61185 req_id = b61ca9b5-b6f9-413e-ac19-a1a854490d37 response_code = 200 uri = /vpc-routes
24322025-01-17T08:31:44.188ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
24332025-01-17T08:31:44.188ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 82 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61185 req_id = d9a74197-28bd-46f6-93a6-01ba3bf9b2f4 response_code = 204 uri = /eip-gateways
24342025-01-17T08:31:44.195ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 279 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61185 req_id = fd1a6715-3519-4764-b5b8-1a42bd209c2b response_code = 204 uri = /vpc-routes
24352025-01-17T08:31:44.247ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:56655
24362025-01-17T08:31:44.247ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24372025-01-17T08:31:44.286ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24382025-01-17T08:31:44.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97457 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:56655 req_id = 1a9c5f18-8109-42df-8c1a-c55f0cbedcf9 response_code = 204 uri = /switch-ports
24392025-01-17T08:31:44.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 100 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:56655 req_id = 8e662cf9-8e82-487d-a7fc-6f595fa1a765 response_code = 200 uri = /network-bootstore-config
24402025-01-17T08:31:49.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56699
24412025-01-17T08:31:49.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56699 req_id = b44bd635-deb3-42db-ba8a-5cbf21db61a7 response_code = 200 uri = /vpc-routes
24422025-01-17T08:31:49.191ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
24432025-01-17T08:31:49.191ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56699 req_id = 9df10040-cfca-4ae8-a1fe-94b58be6882f response_code = 204 uri = /eip-gateways
24442025-01-17T08:31:49.201ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:56699 req_id = 97fc74cb-40a5-4999-8306-f55253594df2 response_code = 204 uri = /vpc-routes
24452025-01-17T08:31:49.257ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:56624
24462025-01-17T08:31:49.257ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:56624 req_id = 88ba1837-7ef3-4b0a-894b-33a3fda69bbc response_code = 200 uri = /v2p
24472025-01-17T08:31:49.292ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63783
24482025-01-17T08:31:49.292ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24492025-01-17T08:31:49.331ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24502025-01-17T08:31:49.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95807 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63783 req_id = 55c90657-d8a0-4627-b472-bd49edf03a50 response_code = 204 uri = /switch-ports
24512025-01-17T08:31:49.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63783 req_id = d6fecef9-e97e-46a8-b543-c561bceaf20d response_code = 200 uri = /network-bootstore-config
24522025-01-17T08:31:53.508ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6180 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 98d34f81-34a1-474e-b076-f1bbc0aeca7c response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
24532025-01-17T08:32:11.630ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:35336
24542025-01-17T08:32:11.630ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 44 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:35336 req_id = a306de12-d46c-4bbf-b7b6-bb4c81276a4f response_code = 200 uri = /baseboard
24552025-01-17T08:32:12.189ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:39332
24562025-01-17T08:32:12.189ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:39332 req_id = 768cd846-0ff5-48e1-b2e8-11802f7fa575 response_code = 200 uri = /vpc-routes
24572025-01-17T08:32:12.190ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43326
24582025-01-17T08:32:12.190ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43326 req_id = 2e517bdf-961c-43dc-ae6f-a506b8f0299a response_code = 200 uri = /v2p
24592025-01-17T08:32:12.232ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
24602025-01-17T08:32:12.232ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39332 req_id = cd3dd1fe-bd2b-49e9-b969-b31896e16347 response_code = 204 uri = /eip-gateways
24612025-01-17T08:32:12.242ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 302 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:39332 req_id = b41a47c1-69b3-4456-be28-7e62e5f78ce9 response_code = 204 uri = /vpc-routes
24622025-01-17T08:32:12.283ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:56319
24632025-01-17T08:32:12.283ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24642025-01-17T08:32:12.322ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24652025-01-17T08:32:12.380ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 97091 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:56319 req_id = 8b730487-d802-4397-98d8-20fecd18a523 response_code = 204 uri = /switch-ports
24662025-01-17T08:32:12.383ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 81 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:56319 req_id = 7efbad11-d4b6-4024-bbcd-966c7326d649 response_code = 200 uri = /network-bootstore-config
24672025-01-17T08:32:13.958ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64794
24682025-01-17T08:32:13.959ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 99 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64794 req_id = bf59c238-33b2-463d-92f2-63243a302d61 response_code = 200 uri = /vpc-routes
24692025-01-17T08:32:14.007ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
24702025-01-17T08:32:14.007ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 117 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64794 req_id = 4b0d5555-6a7c-4a84-84ce-e14559a46bfa response_code = 204 uri = /eip-gateways
24712025-01-17T08:32:14.016ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 244 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:64794 req_id = 61862186-6916-40b8-8719-40002c730101 response_code = 204 uri = /vpc-routes
24722025-01-17T08:32:14.041ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39641
24732025-01-17T08:32:14.041ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24742025-01-17T08:32:14.081ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24752025-01-17T08:32:14.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96561 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:39641 req_id = 9356456e-18b5-4913-8c61-b2c46bf027e0 response_code = 204 uri = /switch-ports
24762025-01-17T08:32:14.138ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37633
24772025-01-17T08:32:14.138ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 190 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37633 req_id = cf69f8d9-cf15-47d8-a28e-dc1bd1f3ea0a response_code = 200 uri = /v2p
24782025-01-17T08:32:14.139ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:39641 req_id = d8b1d806-8e33-4466-b812-aa97b4f3d23b response_code = 200 uri = /network-bootstore-config
24792025-01-17T08:32:18.973ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36388
24802025-01-17T08:32:18.973ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 53 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36388 req_id = fea51a57-d962-43c3-b634-31a5e51d911f response_code = 200 uri = /vpc-routes
24812025-01-17T08:32:18.986ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:57263
24822025-01-17T08:32:18.986ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 126 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:57263 req_id = 04344f52-5df8-4e32-9281-22bf658c8b6f response_code = 200 uri = /v2p
24832025-01-17T08:32:19.018ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
24842025-01-17T08:32:19.018ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 69 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36388 req_id = c8b45cdc-9074-45b0-89f4-30c2b905b4c1 response_code = 204 uri = /eip-gateways
24852025-01-17T08:32:19.027ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 237 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36388 req_id = d8fe11b2-9a81-45df-b5f8-3089a2b86255 response_code = 204 uri = /vpc-routes
24862025-01-17T08:32:19.058ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50813
24872025-01-17T08:32:19.058ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
24882025-01-17T08:32:19.095ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
24892025-01-17T08:32:19.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90363 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50813 req_id = 6eee108f-7981-418b-af76-00d53527e5cf response_code = 204 uri = /switch-ports
24902025-01-17T08:32:19.149ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 248 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50813 req_id = 6bc9aab2-393d-4d32-b43d-38a61865a7f5 response_code = 200 uri = /network-bootstore-config
24912025-01-17T08:32:23.509ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7167 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 4a58144c-fdf3-4ea6-a6ab-e566048c0ebf response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
24922025-01-17T08:32:41.664ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:65369
24932025-01-17T08:32:41.664ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:65369 req_id = ceb85453-0b8a-4dfc-a918-6f7c9f0cb136 response_code = 200 uri = /baseboard
24942025-01-17T08:32:42.176ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:58716
24952025-01-17T08:32:42.176ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 46 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:58716 req_id = 618c1658-4a49-41f2-a6f0-44fe24dd639e response_code = 200 uri = /vpc-routes
24962025-01-17T08:32:42.221ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
24972025-01-17T08:32:42.221ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58716 req_id = 81faee38-d514-46e8-a612-5fd5c2d54986 response_code = 204 uri = /eip-gateways
24982025-01-17T08:32:42.436ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:46421
24992025-01-17T08:32:42.437ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 175 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:46421 req_id = 83c59b99-e40d-4d0d-8525-1e2fbe2d4def response_code = 200 uri = /v2p
25002025-01-17T08:32:42.444ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 201 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:58716 req_id = 3ce03e09-5e32-4f92-becb-e78dc59b3b98 response_code = 204 uri = /vpc-routes
25012025-01-17T08:32:42.479ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:48876
25022025-01-17T08:32:42.479ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25032025-01-17T08:32:42.517ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25042025-01-17T08:32:42.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90514 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:48876 req_id = 3ad2da95-49f5-4cd8-890a-0fdeaf345869 response_code = 204 uri = /switch-ports
25052025-01-17T08:32:42.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 102 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:48876 req_id = 46303ddf-ec1a-4217-b33d-f901af52d9eb response_code = 200 uri = /network-bootstore-config
25062025-01-17T08:32:44.339ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:60745
25072025-01-17T08:32:44.339ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:60745 req_id = abce6c0b-04ae-4e7d-86d9-8e84931bf440 response_code = 200 uri = /vpc-routes
25082025-01-17T08:32:44.388ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
25092025-01-17T08:32:44.388ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60745 req_id = c018c8d0-118c-4baa-a550-23e59f5c6556 response_code = 204 uri = /eip-gateways
25102025-01-17T08:32:44.397ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:60745 req_id = db220b41-0f7d-464d-9bd2-384b427d004f response_code = 204 uri = /vpc-routes
25112025-01-17T08:32:44.401ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:37753
25122025-01-17T08:32:44.401ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25132025-01-17T08:32:44.441ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25142025-01-17T08:32:44.495ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94071 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:37753 req_id = aa125e47-48cb-4607-b774-62a641ddd75c response_code = 204 uri = /switch-ports
25152025-01-17T08:32:44.495ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64931
25162025-01-17T08:32:44.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64931 req_id = 1526755f-4483-4ff1-b269-f504cc0a6836 response_code = 200 uri = /v2p
25172025-01-17T08:32:44.496ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 228 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:37753 req_id = a13f3faf-5c43-45f9-9392-1d3771a7c51d response_code = 200 uri = /network-bootstore-config
25182025-01-17T08:32:49.036ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:42235
25192025-01-17T08:32:49.037ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 145 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:42235 req_id = 74dcb0e5-1afa-4f74-a127-b761991de47f response_code = 200 uri = /v2p
25202025-01-17T08:32:49.038ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:54552
25212025-01-17T08:32:49.038ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 29 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:54552 req_id = 0c11801a-c736-463b-b0b7-0068ba7d1b12 response_code = 200 uri = /vpc-routes
25222025-01-17T08:32:49.058ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
25232025-01-17T08:32:49.058ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 62 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54552 req_id = 1d1ded38-ad2d-4afe-b845-ebcc46a4b663 response_code = 204 uri = /eip-gateways
25242025-01-17T08:32:49.067ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 191 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:54552 req_id = 8ae2fb79-a8fe-4ad5-ba8b-e313d7c4a11f response_code = 204 uri = /vpc-routes
25252025-01-17T08:32:49.258ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:63633
25262025-01-17T08:32:49.258ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25272025-01-17T08:32:49.293ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25282025-01-17T08:32:49.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 88869 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:63633 req_id = ceddc51f-0344-4841-ae81-8259f384ded6 response_code = 204 uri = /switch-ports
25292025-01-17T08:32:49.347ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 91 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:63633 req_id = 841ec528-23fc-439b-aebb-052c5d9b3c24 response_code = 200 uri = /network-bootstore-config
25302025-01-17T08:32:53.508ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6122 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 0ef70a17-2b6e-4724-8a14-6e87d0b6af3b response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
25312025-01-17T08:33:11.697ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:47112
25322025-01-17T08:33:11.697ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 101 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:47112 req_id = 2e5e85de-e2af-4be8-a492-4806bb7a6440 response_code = 200 uri = /baseboard
25332025-01-17T08:33:12.113ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:42224
25342025-01-17T08:33:12.113ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 49 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:42224 req_id = 732ff70c-dc81-4a2a-ad61-c26c1897f2ae response_code = 200 uri = /vpc-routes
25352025-01-17T08:33:12.164ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
25362025-01-17T08:33:12.164ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 76 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42224 req_id = 0758ff34-ba81-423b-bfff-0ff88e1ef6bf response_code = 204 uri = /eip-gateways
25372025-01-17T08:33:12.173ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 260 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:42224 req_id = 2a0ce6c9-9782-4ed8-a98d-b3f376ad8bb5 response_code = 204 uri = /vpc-routes
25382025-01-17T08:33:12.205ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:36765
25392025-01-17T08:33:12.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 108 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:36765 req_id = cf0add86-0870-440a-a3f1-f20568cd57d4 response_code = 200 uri = /v2p
25402025-01-17T08:33:12.254ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57431
25412025-01-17T08:33:12.254ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25422025-01-17T08:33:12.292ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25432025-01-17T08:33:12.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90917 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:57431 req_id = 528789d7-d3a9-42d0-adba-54dbe8d768df response_code = 204 uri = /switch-ports
25442025-01-17T08:33:12.345ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 107 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57431 req_id = 4f704d61-0951-4594-99e8-1db24ec5b68f response_code = 200 uri = /network-bootstore-config
25452025-01-17T08:33:14.006ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53038
25462025-01-17T08:33:14.006ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53038 req_id = bb80994a-28f8-4d84-9192-b1648a25f9f7 response_code = 200 uri = /vpc-routes
25472025-01-17T08:33:14.016ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50307
25482025-01-17T08:33:14.017ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 144 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50307 req_id = d0a7b872-8aee-492a-85ac-70406b4dc8ef response_code = 200 uri = /v2p
25492025-01-17T08:33:14.055ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
25502025-01-17T08:33:14.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 72 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53038 req_id = ff4dd4ce-a830-4cc6-97e0-7fc031bd3681 response_code = 204 uri = /eip-gateways
25512025-01-17T08:33:14.064ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:53038 req_id = 216fccd0-a659-4088-bc85-960487a2ec59 response_code = 204 uri = /vpc-routes
25522025-01-17T08:33:14.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:40717
25532025-01-17T08:33:14.087ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25542025-01-17T08:33:14.128ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25552025-01-17T08:33:14.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 94439 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:40717 req_id = 2e42613c-8851-44a5-9c82-bcbfbe536a07 response_code = 204 uri = /switch-ports
25562025-01-17T08:33:14.182ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:40717 req_id = caebda13-a933-45ab-9839-292f664f8aae response_code = 200 uri = /network-bootstore-config
25572025-01-17T08:33:18.821ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:33282
25582025-01-17T08:33:18.821ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 74 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:33282 req_id = b569c5f9-2aa0-4c94-8399-2b06ea103175 response_code = 200 uri = /vpc-routes
25592025-01-17T08:33:18.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
25602025-01-17T08:33:18.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 50 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33282 req_id = 04c9b4b7-f051-4eda-b3e9-13e7e61be4cb response_code = 204 uri = /eip-gateways
25612025-01-17T08:33:18.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 164 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:33282 req_id = 01e24ea9-7d4d-486b-871b-dc0c5b196616 response_code = 204 uri = /vpc-routes
25622025-01-17T08:33:18.889ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:53547
25632025-01-17T08:33:18.890ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:53547 req_id = 83cabc5e-447d-4dee-95dd-42c61703561a response_code = 200 uri = /v2p
25642025-01-17T08:33:18.942ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:37296
25652025-01-17T08:33:18.942ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25662025-01-17T08:33:18.977ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25672025-01-17T08:33:19.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 87626 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:37296 req_id = 6b6974f7-8309-4c9e-b160-e6c49df7c4de response_code = 204 uri = /switch-ports
25682025-01-17T08:33:19.030ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:37296 req_id = 07080224-505a-421c-9e9f-85f74de135de response_code = 200 uri = /network-bootstore-config
25692025-01-17T08:33:23.509ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6545 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = d1ea6549-93ce-44fc-b80e-df4dd6551058 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
25702025-01-17T08:33:41.731ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:32928
25712025-01-17T08:33:41.731ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:32928 req_id = 8685c7db-3d34-4c95-8002-30cd0919b909 response_code = 200 uri = /baseboard
25722025-01-17T08:33:42.308ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:35874
25732025-01-17T08:33:42.308ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 38 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:35874 req_id = 6bfdc725-ec57-4ed7-ab0c-9ec709f7f028 response_code = 200 uri = /vpc-routes
25742025-01-17T08:33:42.372ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
25752025-01-17T08:33:42.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 155 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35874 req_id = de483bae-5383-471c-92ee-e1ca58c425d8 response_code = 204 uri = /eip-gateways
25762025-01-17T08:33:42.395ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 235 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:35874 req_id = adb96856-2fda-46b6-8b5e-29d1dd3f7f03 response_code = 204 uri = /vpc-routes
25772025-01-17T08:33:42.556ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52261
25782025-01-17T08:33:42.556ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 118 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52261 req_id = 1d2fb2d5-d52d-4973-a8bc-9d7d8a89f67b response_code = 200 uri = /v2p
25792025-01-17T08:33:42.594ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:45058
25802025-01-17T08:33:42.594ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
25812025-01-17T08:33:42.633ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
25822025-01-17T08:33:42.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 92477 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:45058 req_id = af890880-f448-45d3-90c9-4b0eb44da736 response_code = 204 uri = /switch-ports
25832025-01-17T08:33:42.687ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:41166
25842025-01-17T08:33:42.687ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 140 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:45058 req_id = bf0a5ff0-dd86-4060-82f1-44e25c06f12d response_code = 200 uri = /network-bootstore-config
25852025-01-17T08:33:42.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25862025-01-17T08:33:42.687ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
25872025-01-17T08:33:42.687ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:177
25882025-01-17T08:33:42.688ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:177
25892025-01-17T08:33:42.702ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25902025-01-17T08:33:42.702ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_028b6e25-416e-42c3-8d32-3331a24bdea1
25912025-01-17T08:33:42.725ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25922025-01-17T08:33:42.725ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739
25932025-01-17T08:33:42.746ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
25942025-01-17T08:33:42.746ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0ab7c39f-5947-4112-8347-2ecc105352ff
25952025-01-17T08:33:42.754ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64475
25962025-01-17T08:33:42.755ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
25972025-01-17T08:33:42.755ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
25982025-01-17T08:33:42.755ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
25992025-01-17T08:33:42.755ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26002025-01-17T08:33:42.755ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26012025-01-17T08:33:42.755ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26022025-01-17T08:33:42.755ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26032025-01-17T08:33:42.755ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:64475 req_id = 2f8d6a24-c89a-4d1b-bc9e-9b00400d1c2d response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26042025-01-17T08:33:42.767ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26052025-01-17T08:33:42.767ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f
26062025-01-17T08:33:42.789ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26072025-01-17T08:33:42.789ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b
26082025-01-17T08:33:42.809ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26092025-01-17T08:33:42.810ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77842ceb-2fab-4804-a283-1a7c8f995913
26102025-01-17T08:33:42.829ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26112025-01-17T08:33:42.829ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab
26122025-01-17T08:33:42.849ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26132025-01-17T08:33:42.849ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded
26142025-01-17T08:33:42.870ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26152025-01-17T08:33:42.870ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0
26162025-01-17T08:33:42.881ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 193501 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:41166 req_id = b678588a-0756-43c5-a7f4-2466f341f807 response_code = 200 uri = /inventory
26172025-01-17T08:33:44.005ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44369
26182025-01-17T08:33:44.005ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 89 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44369 req_id = 8c25b0a1-7292-4248-a51b-1903c9b99356 response_code = 200 uri = /vpc-routes
26192025-01-17T08:33:44.066ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
26202025-01-17T08:33:44.066ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 93 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44369 req_id = c92c4e5e-2689-4487-a68c-75b4cbd996f1 response_code = 204 uri = /eip-gateways
26212025-01-17T08:33:44.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:54018
26222025-01-17T08:33:44.252ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 161 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:54018 req_id = 3a2dd4f4-0ee3-4a77-b7b5-b69cd9188fd6 response_code = 200 uri = /v2p
26232025-01-17T08:33:44.268ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 327 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:44369 req_id = ffdbb3a6-8e91-4547-a618-74f764d9f244 response_code = 204 uri = /vpc-routes
26242025-01-17T08:33:44.442ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:65366
26252025-01-17T08:33:44.442ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26262025-01-17T08:33:44.481ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26272025-01-17T08:33:44.538ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 96547 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:65366 req_id = 91accb00-e974-489a-bafa-886498945cd8 response_code = 204 uri = /switch-ports
26282025-01-17T08:33:44.538ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:64905
26292025-01-17T08:33:44.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26302025-01-17T08:33:44.539ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26312025-01-17T08:33:44.539ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:177
26322025-01-17T08:33:44.539ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 194 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:65366 req_id = 94a461ac-b4f6-464b-8178-f72a3ef62338 response_code = 200 uri = /network-bootstore-config
26332025-01-17T08:33:44.539ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:177
26342025-01-17T08:33:44.550ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26352025-01-17T08:33:44.550ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_028b6e25-416e-42c3-8d32-3331a24bdea1
26362025-01-17T08:33:44.561ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35215
26372025-01-17T08:33:44.562ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26382025-01-17T08:33:44.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26392025-01-17T08:33:44.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26402025-01-17T08:33:44.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26412025-01-17T08:33:44.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26422025-01-17T08:33:44.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26432025-01-17T08:33:44.562ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26442025-01-17T08:33:44.562ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 480 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35215 req_id = 8918162f-3db1-4c1e-b0fd-91de05bcea17 response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26452025-01-17T08:33:44.573ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26462025-01-17T08:33:44.573ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739
26472025-01-17T08:33:44.596ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26482025-01-17T08:33:44.596ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0ab7c39f-5947-4112-8347-2ecc105352ff
26492025-01-17T08:33:44.618ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26502025-01-17T08:33:44.618ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f
26512025-01-17T08:33:44.641ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26522025-01-17T08:33:44.641ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b
26532025-01-17T08:33:44.663ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26542025-01-17T08:33:44.663ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77842ceb-2fab-4804-a283-1a7c8f995913
26552025-01-17T08:33:44.684ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26562025-01-17T08:33:44.684ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab
26572025-01-17T08:33:44.704ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26582025-01-17T08:33:44.704ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded
26592025-01-17T08:33:44.724ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26602025-01-17T08:33:44.724ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0
26612025-01-17T08:33:44.735ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 196915 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:64905 req_id = 7bc2784d-05fa-4568-a9fe-e5dbeeff88b0 response_code = 200 uri = /inventory
26622025-01-17T08:33:49.156ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:55625
26632025-01-17T08:33:49.156ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 55 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:55625 req_id = 4bcd8520-0593-468c-943e-93206e19ee6e response_code = 200 uri = /vpc-routes
26642025-01-17T08:33:49.205ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
26652025-01-17T08:33:49.205ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 71 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55625 req_id = 93cace69-8fc4-4b28-b9b9-3b91d99b201e response_code = 204 uri = /eip-gateways
26662025-01-17T08:33:49.212ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 174 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:55625 req_id = cf8b02b3-0804-4082-a0ee-a51f8e2a2d76 response_code = 204 uri = /vpc-routes
26672025-01-17T08:33:49.420ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:41737
26682025-01-17T08:33:49.420ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:41737 req_id = 304e4677-b887-492c-afd2-9b39228b9400 response_code = 200 uri = /v2p
26692025-01-17T08:33:49.422ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61370
26702025-01-17T08:33:49.423ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26712025-01-17T08:33:49.423ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
26722025-01-17T08:33:49.423ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/config/omicron-zones.json file = common/src/ledger.rs:177
26732025-01-17T08:33:49.423ZINFOSledAgent (ServiceManager): Reading ledger from /pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/config/omicron-zones.json file = common/src/ledger.rs:177
26742025-01-17T08:33:49.435ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 028b6e25-416e-42c3-8d32-3331a24bdea1 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26752025-01-17T08:33:49.435ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_028b6e25-416e-42c3-8d32-3331a24bdea1
26762025-01-17T08:33:49.435ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:50631
26772025-01-17T08:33:49.440ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
26782025-01-17T08:33:49.463ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0f4e45ca-0c5e-4431-a74e-c13592f9c739 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26792025-01-17T08:33:49.464ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0f4e45ca-0c5e-4431-a74e-c13592f9c739
26802025-01-17T08:33:49.480ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:47902
26812025-01-17T08:33:49.480ZINFOSledAgent (PortManager): Ensuring VPC firewall rules file = illumos-utils/src/opte/port_manager.rs:767 rules = [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 319cce44-4edd-4db3-97f8-611e1dae6725, kind: Service { id: 18904103-4d17-4503-9e6b-f36462ac2ff6 }, name: Name("external-dns-18904103-4d17-4503-9e6b-f36462ac2ff6"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 150, 247])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 8d160529-0393-4c3f-9c6a-d8f8997e01a2, kind: Service { id: ab585232-40d2-4a9e-a5a8-6d9e5f36808d }, name: Name("external-dns-ab585232-40d2-4a9e-a5a8-6d9e5f36808d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 248, 106])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(53), last: L4Port(53) }]), filter_protocols: Some([Udp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 40ccbd9a-0a56-4c4f-a3f4-c75b4a2779ff, kind: Service { id: c34158a3-fac5-4036-bee4-fac8eb171c5f }, name: Name("nexus-c34158a3-fac5-4036-bee4-fac8eb171c5f"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 130, 157])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 554d0564-6c57-409f-86b1-7f3498e7187e, kind: Service { id: 19f23d34-e15e-4f8e-9774-d53b0a1078cd }, name: Name("nexus-19f23d34-e15e-4f8e-9774-d53b0a1078cd"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 192, 254])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 81eaa294-ad3e-4931-81cd-d942c5898187, kind: Service { id: b72586ef-ab31-4002-9c99-4f4040a5f525 }, name: Name("nexus-b72586ef-ab31-4002-9c99-4f4040a5f525"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 198, 222])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(80), last: L4Port(80) }, L4PortRange { first: L4Port(443), last: L4Port(443) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }] vni = Vni(100)
26822025-01-17T08:33:49.481ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte1" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26832025-01-17T08:33:49.481ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte2" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26842025-01-17T08:33:49.481ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte0" rules = []
26852025-01-17T08:33:49.481ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte3" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26862025-01-17T08:33:49.481ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte4" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(TCP), ports: PortList([80, 443]) }, action: Allow, priority: 65534 }]
26872025-01-17T08:33:49.481ZINFOSledAgent (PortManager): Setting OPTE firewall rules file = illumos-utils/src/opte/port_manager.rs:786 port = "opte5" rules = [FirewallRule { direction: In, filters: Filters { hosts: Any, protocol: Proto(UDP), ports: PortList([53]) }, action: Allow, priority: 65534 }]
26882025-01-17T08:33:49.481ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 627 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:47902 req_id = cf0cbbb3-1ec6-4da8-8b8e-26ff201f16ca response_code = 204 uri = /vpc/001de000-074c-4000-8000-000000000000/firewall/rules
26892025-01-17T08:33:49.481ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
26902025-01-17T08:33:49.488ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 0ab7c39f-5947-4112-8347-2ecc105352ff (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26912025-01-17T08:33:49.488ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_0ab7c39f-5947-4112-8347-2ecc105352ff
26922025-01-17T08:33:49.512ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 7334e89a-2cf5-468f-9abc-bbdb79aae52f (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26932025-01-17T08:33:49.513ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_7334e89a-2cf5-468f-9abc-bbdb79aae52f
26942025-01-17T08:33:49.537ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 50ae3ebe-f6db-4363-9ce2-1b7bceae052b (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26952025-01-17T08:33:49.537ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_50ae3ebe-f6db-4363-9ce2-1b7bceae052b
26962025-01-17T08:33:49.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 103398 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:50631 req_id = d9c46487-69a7-4294-808d-616464663681 response_code = 204 uri = /switch-ports
26972025-01-17T08:33:49.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:50631 req_id = c3d4165c-1c13-47d3-b534-e2579ec1d081 response_code = 200 uri = /network-bootstore-config
26982025-01-17T08:33:49.560ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 77842ceb-2fab-4804-a283-1a7c8f995913 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
26992025-01-17T08:33:49.560ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_77842ceb-2fab-4804-a283-1a7c8f995913
27002025-01-17T08:33:49.581ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27012025-01-17T08:33:49.581ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab
27022025-01-17T08:33:49.601ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 053808f0-a6b0-465b-8cf3-e8a8ce7f5ded (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27032025-01-17T08:33:49.601ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_053808f0-a6b0-465b-8cf3-e8a8ce7f5ded
27042025-01-17T08:33:49.624ZINFOSledAgent (StorageManager): Received DatasetsList { zpool: ZpoolName { id: 808a66ec-46e9-4cf6-85b9-8ffbd6027ec0 (zpool), kind: External }, tx: ... } file = sled-storage/src/manager.rs:607
27052025-01-17T08:33:49.624ZINFOSledAgent (StorageManager): Listing datasets within zpool file = sled-storage/src/manager.rs:1118 request = datasets_list zpool = oxp_808a66ec-46e9-4cf6-85b9-8ffbd6027ec0
27062025-01-17T08:33:49.637ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 214000 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61370 req_id = f965b36e-5083-4ed6-9657-673417adfc27 response_code = 200 uri = /inventory
27072025-01-17T08:33:53.510ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 7576 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = 6281483a-64fd-47c3-b660-c81c140b1706 response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27082025-01-17T08:34:11.764ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:39007
27092025-01-17T08:34:11.764ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 36 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:39007 req_id = 6ba487f7-7ef4-4eda-a9c6-74d1beb2cb38 response_code = 200 uri = /baseboard
27102025-01-17T08:34:12.201ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:52640
27112025-01-17T08:34:12.202ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 123 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:52640 req_id = d3a2d0b2-ea11-45cf-a35e-279d94ef0bc0 response_code = 200 uri = /v2p
27122025-01-17T08:34:12.228ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:63192
27132025-01-17T08:34:12.228ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 40 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:63192 req_id = 6be58cc2-8c98-4d69-8cd8-f386ee0746eb response_code = 200 uri = /vpc-routes
27142025-01-17T08:34:12.269ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
27152025-01-17T08:34:12.269ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 63 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63192 req_id = 4add52da-c0a4-41e4-87ab-2a4154a88a85 response_code = 204 uri = /eip-gateways
27162025-01-17T08:34:12.279ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 222 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:63192 req_id = eaf39cae-12a1-4567-bd6e-6b0e17862501 response_code = 204 uri = /vpc-routes
27172025-01-17T08:34:12.303ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:51298
27182025-01-17T08:34:12.303ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27192025-01-17T08:34:12.340ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27202025-01-17T08:34:12.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 90813 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:51298 req_id = d19ae0b5-446e-4fe6-94ff-fb3f0b58d509 response_code = 204 uri = /switch-ports
27212025-01-17T08:34:12.394ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:51298 req_id = 4e353806-bed4-4216-8854-3b9bbbb605ab response_code = 200 uri = /network-bootstore-config
27222025-01-17T08:34:13.999ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41423
27232025-01-17T08:34:14.000ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 105 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41423 req_id = 6706b31f-c565-4e01-9bfa-b2e193b8ba89 response_code = 200 uri = /vpc-routes
27242025-01-17T08:34:14.046ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
27252025-01-17T08:34:14.046ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41423 req_id = 7e2cc003-cbdb-48f1-a79e-c4fd7957a57f response_code = 204 uri = /eip-gateways
27262025-01-17T08:34:14.055ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 238 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41423 req_id = b8554a19-184a-4bd3-9619-95f97895aacd response_code = 204 uri = /vpc-routes
27272025-01-17T08:34:14.087ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58524
27282025-01-17T08:34:14.087ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27292025-01-17T08:34:14.134ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27302025-01-17T08:34:14.199ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 112278 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:58524 req_id = 14849f96-589f-4f92-b922-d7e192ac415e response_code = 204 uri = /switch-ports
27312025-01-17T08:34:14.199ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:53438
27322025-01-17T08:34:14.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:53438 req_id = 0d401664-29cc-453a-83db-3c0d468b498a response_code = 200 uri = /v2p
27332025-01-17T08:34:14.200ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 231 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58524 req_id = 4eddcc8c-7f24-42b3-b0a9-758cdd130d6e response_code = 200 uri = /network-bootstore-config
27342025-01-17T08:34:18.846ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:36041
27352025-01-17T08:34:18.846ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 42 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:36041 req_id = f2b48e7c-a1e0-4224-94a5-61eb4ccae19b response_code = 200 uri = /vpc-routes
27362025-01-17T08:34:18.861ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
27372025-01-17T08:34:18.861ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 64 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36041 req_id = 43d2e3c3-f250-430b-94ae-56fc19c82782 response_code = 204 uri = /eip-gateways
27382025-01-17T08:34:18.870ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 177 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::c]:36041 req_id = bc94f3a2-1bfb-44d7-963d-08f97320a6c5 response_code = 204 uri = /vpc-routes
27392025-01-17T08:34:18.939ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:46959
27402025-01-17T08:34:18.939ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 116 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:46959 req_id = 998ff9e5-152a-4df4-9241-0a8e98c4762a response_code = 200 uri = /v2p
27412025-01-17T08:34:18.996ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::c]:61001
27422025-01-17T08:34:18.997ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
27432025-01-17T08:34:19.036ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
27442025-01-17T08:34:19.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98133 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::c]:61001 req_id = 67152b65-05b3-40b1-bb7b-e99838544aa3 response_code = 204 uri = /switch-ports
27452025-01-17T08:34:19.095ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 113 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::c]:61001 req_id = fc00bb00-786e-4912-a1cf-b9d8533362ed response_code = 200 uri = /network-bootstore-config
27462025-01-17T08:34:23.160ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:50969
27472025-01-17T08:34:23.160ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 139 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:50969 req_id = ff18775a-d37a-4805-9a6f-9fa01c06280b response_code = 200 uri = /v2p
27482025-01-17T08:34:23.162ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(16430372) }
27492025-01-17T08:34:23.162ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1686 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:50969 req_id = 488ca726-2993-4e76-92d8-39411e61e2f6 response_code = 204 uri = /v2p
27502025-01-17T08:34:23.271ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:63140
27512025-01-17T08:34:23.274ZINFOSledAgent (InstanceManager): ensuring instance is registered file = sled-agent/src/instance_manager.rs:555 hardware = InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 60f23a6c-0eab-437e-b374-a5b99b9e0d54, kind: Instance { id: fe4e411b-6385-4535-894a-f7e7e7ac5d5f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16430372), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 60f23a6c-0eab-437e-b374-a5b99b9e0d54, kind: Instance { id: fe4e411b-6385-4535-894a-f7e7e7ac5d5f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16430372), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 60f23a6c-0eab-437e-b374-a5b99b9e0d54, kind: Instance { id: fe4e411b-6385-4535-894a-f7e7e7ac5d5f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16430372), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16430372))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 60f23a6c-0eab-437e-b374-a5b99b9e0d54, kind: Instance { id: fe4e411b-6385-4535-894a-f7e7e7ac5d5f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16430372), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 872b28ae-a347-4f08-90cd-07999d426441, slot: 0, read_only: false, vcr_json: .., name: "disk-a4a57834c27" }], boot_settings: Some(InstanceBootSettings { order: [872b28ae-a347-4f08-90cd-07999d426441] }), cloud_init_bytes: Some(..) } instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f metadata = InstanceMetadata { silo_id: 603edd29-2275-4ced-9f13-a1ccdff45ca3, project_id: a67a60de-0cac-4068-8294-f4205972bd35 } migration_id = None propolis_addr = [fd00:1122:3344:101::1:0]:12400 propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 vmm_runtime = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-17T08:34:23.271175116Z }
27522025-01-17T08:34:23.274ZINFOSledAgent (InstanceManager): registering new instance file = sled-agent/src/instance_manager.rs:588 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f migration_id = None propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27532025-01-17T08:34:23.274ZINFOSledAgent (InstanceManager): initializing new Instance file = sled-agent/src/instance.rs:1563 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f migration_id = None propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 state = InstanceInitialState { hardware: InstanceHardware { properties: InstanceProperties { ncpus: InstanceCpuCount(2), memory: ByteCount(1073741824), hostname: Hostname("localshark") }, nics: [NetworkInterface { id: 60f23a6c-0eab-437e-b374-a5b99b9e0d54, kind: Instance { id: fe4e411b-6385-4535-894a-f7e7e7ac5d5f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16430372), primary: true, slot: 0, transit_ips: [] }], source_nat: SourceNatConfig { ip: 10.151.2.175, first_port: 0, last_port: 16383 }, ephemeral_ip: Some(10.151.2.176), floating_ips: [], firewall_rules: [ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 60f23a6c-0eab-437e-b374-a5b99b9e0d54, kind: Instance { id: fe4e411b-6385-4535-894a-f7e7e7ac5d5f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16430372), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: None, filter_protocols: Some([Icmp]), action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 60f23a6c-0eab-437e-b374-a5b99b9e0d54, kind: Instance { id: fe4e411b-6385-4535-894a-f7e7e7ac5d5f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16430372), primary: true, slot: 0, transit_ips: [] }], filter_hosts: Some([Vpc(Vni(16430372))]), filter_ports: None, filter_protocols: None, action: Allow, priority: VpcFirewallRulePriority(65534) }, ResolvedVpcFirewallRule { status: Enabled, direction: Inbound, targets: [NetworkInterface { id: 60f23a6c-0eab-437e-b374-a5b99b9e0d54, kind: Instance { id: fe4e411b-6385-4535-894a-f7e7e7ac5d5f }, name: Name("net0"), ip: 172.30.0.5, mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), vni: Vni(16430372), primary: true, slot: 0, transit_ips: [] }], filter_hosts: None, filter_ports: Some([L4PortRange { first: L4Port(22), last: L4Port(22) }]), filter_protocols: Some([Tcp]), action: Allow, priority: VpcFirewallRulePriority(65534) }], dhcp_config: DhcpConfig { dns_servers: [1.1.1.1, 9.9.9.9], host_domain: None, search_domains: [] }, disks: [InstanceDisk { disk_id: 872b28ae-a347-4f08-90cd-07999d426441, slot: 0, read_only: false, vcr_json: .., name: "disk-a4a57834c27" }], boot_settings: Some(InstanceBootSettings { order: [872b28ae-a347-4f08-90cd-07999d426441] }), cloud_init_bytes: Some(..) }, vmm_runtime: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-01-17T08:34:23.271175116Z }, propolis_addr: [fd00:1122:3344:101::1:0]:12400, migration_id: None }
27542025-01-17T08:34:23.274ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 2744 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:63140 req_id = 187b1f92-4a7a-446c-94f2-a9a3d440e284 response_code = 200 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382
27552025-01-17T08:34:23.377ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:61264
27562025-01-17T08:34:23.378ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:61264 req_id = aa4c3417-733f-4970-bcae-74e6ab56ec83 response_code = 200 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382/state
27572025-01-17T08:34:23.379ZINFOSledAgent (PortManager): Created OPTE port file = illumos-utils/src/opte/port_manager.rs:447 port = Port { inner: PortInner(PortData { name: "opte6", ip: 172.30.0.5, mac: MacAddr6([168, 64, 37, 240, 0, 0]), slot: 0, vni: Vni { inner: 16430372 }, subnet: V4(Ipv4Net { addr: 172.30.0.0, width: 22 }), gateway: Gateway { mac: MacAddr6([168, 64, 37, 255, 119, 119]), ip: 172.30.0.1 } }) }
27582025-01-17T08:34:23.379ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27592025-01-17T08:34:23.416ZINFOSledAgent (InstanceManager): Configuring new Omicron zone: oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382 file = illumos-utils/src/zone.rs:325 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27602025-01-17T08:34:23.441ZINFOSledAgent (InstanceManager): Installing Omicron zone: oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382 file = illumos-utils/src/zone.rs:363 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27612025-01-17T08:34:23.510ZINFOSledAgent (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6700 local_addr = [fd00:1122:3344:101::1]:48872 method = GET remote_addr = [fd00:1122:3344:101::d]:64355 req_id = fc56c9bd-9077-411d-ad1e-6644234ed1ec response_code = 200 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e uri = /fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27622025-01-17T08:34:23.543ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:35588
27632025-01-17T08:34:23.543ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 48 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:35588 req_id = 9ba1eb28-4882-420c-8453-8e516271caf8 response_code = 200 uri = /vpc-routes
27642025-01-17T08:34:23.597ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {60f23a6c-0eab-437e-b374-a5b99b9e0d54: {10.151.2.175: {8abf940b-896d-46ba-8103-17a071fd4f76}, 10.151.2.176: {8abf940b-896d-46ba-8103-17a071fd4f76}}} }
27652025-01-17T08:34:24.517ZINFOSledAgent (InstanceManager): Profile for oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382: <!DOCTYPE service_bundle SYSTEM "/usr/share/lib/xml/dtd/service_bundle.dtd.1"> <service_bundle type="profile" name="omicron"> <service version="1" type="service" name="system/illumos/propolis-server"> <instance enabled="true" name="default"> <property_group type="application" name="config"> <propval type="astring" name="datalink" value='oxControlInstance0'/> <propval type="astring" name="gateway" value='fd00:1122:3344:101::1'/> <propval type="astring" name="listen_addr" value='fd00:1122:3344:101::1:0'/> <propval type="astring" name="listen_port" value='12400'/> <propval type="astring" name="metric_addr" value='dns'/> </property_group> </instance> </service> </service_bundle> file = sled-agent/src/profile.rs:34 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27662025-01-17T08:34:24.517ZINFOSledAgent (InstanceManager): Booting oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382 zone file = illumos-utils/src/running_zone.rs:488 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27672025-01-17T08:34:24.703ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 42.487766ms file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27682025-01-17T08:34:24.754ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 64.101299ms file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27692025-01-17T08:34:24.834ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 289.751405ms file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27702025-01-17T08:34:25.141ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 262.294658ms file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27712025-01-17T08:34:25.418ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 424.778383ms file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27722025-01-17T08:34:25.855ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 779.327109ms file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27732025-01-17T08:34:26.647ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 1.019677742s file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27742025-01-17T08:34:27.677ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 643.206608ms file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27752025-01-17T08:34:28.332ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 568.919124ms file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27762025-01-17T08:34:28.912ZWARNSledAgent (InstanceManager): wait for service Some("oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382") failed: Property not found. retry in 1.173672793s file = illumos-utils/src/svc.rs:42 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 zone = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
27772025-01-17T08:34:30.119ZINFOSledAgent (InstanceManager): Started propolis in zone: oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382 file = sled-agent/src/instance.rs:2068 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27782025-01-17T08:34:30.130ZINFOSledAgent (InstanceManager): Propolis SMF service is online file = sled-agent/src/instance.rs:2077 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27792025-01-17T08:34:30.175ZINFOSledAgent (InstanceManager): Propolis HTTP server online file = sled-agent/src/instance.rs:2101 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27802025-01-17T08:34:30.371ZINFOSledAgent (InstanceManager): result of instance_ensure call is Ok(InstanceEnsureResponse { migrate: None }) file = sled-agent/src/instance.rs:1214 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27812025-01-17T08:34:30.372ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
27822025-01-17T08:34:30.372ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 6775405 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35588 req_id = efc145e4-2b05-46b7-97ce-55a91fb1fbea response_code = 204 uri = /eip-gateways
27832025-01-17T08:34:30.373ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Creating), migration_in: None, migration_out: None, time: 2025-01-17T08:34:30.373617459Z } file = sled-agent/src/instance.rs:781 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27842025-01-17T08:34:30.373ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f new_vmm_state = VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-17T08:34:30.373617459Z } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27852025-01-17T08:34:30.373ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(3), time_updated: 2025-01-17T08:34:30.373617459Z }, migration_in: None, migration_out: None }
27862025-01-17T08:34:30.421ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Running), migration_in: None, migration_out: None, time: 2025-01-17T08:34:30.421494589Z } file = sled-agent/src/instance.rs:781 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27872025-01-17T08:34:30.421ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f new_vmm_state = VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-17T08:34:30.421494589Z } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27882025-01-17T08:34:30.421ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 state = SledVmmState { vmm_state: VmmRuntimeState { state: Running, gen: Generation(4), time_updated: 2025-01-17T08:34:30.421494589Z }, migration_in: None, migration_out: None }
27892025-01-17T08:34:30.473ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 876 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:35588 req_id = 9e1b792c-b7d0-42de-8913-97217d73d001 response_code = 204 uri = /vpc-routes
27902025-01-17T08:34:40.961ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:39165
27912025-01-17T08:34:40.962ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 520 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:39165 req_id = 0e0e832b-ad4e-4309-b61f-6315f819813a response_code = 200 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382/state
27922025-01-17T08:34:40.962ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Stopping), migration_in: None, migration_out: None, time: 2025-01-17T08:34:40.962525588Z } file = sled-agent/src/instance.rs:781 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27932025-01-17T08:34:40.962ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f new_vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-17T08:34:40.962525588Z } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27942025-01-17T08:34:40.962ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 state = SledVmmState { vmm_state: VmmRuntimeState { state: Stopping, gen: Generation(6), time_updated: 2025-01-17T08:34:40.962525588Z }, migration_in: None, migration_out: None }
27952025-01-17T08:34:40.971ZINFOSledAgent (InstanceManager): Observing new propolis state: ObservedPropolisState { vmm_state: PropolisInstanceState(Destroyed), migration_in: None, migration_out: None, time: 2025-01-17T08:34:40.971910842Z } file = sled-agent/src/instance.rs:781 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27962025-01-17T08:34:40.971ZINFOSledAgent (InstanceManager): updated state after observing Propolis state change file = sled-agent/src/instance.rs:803 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f new_vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(7), time_updated: 2025-01-17T08:34:40.971910842Z } propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27972025-01-17T08:34:40.971ZINFOSledAgent (InstanceManager): terminating VMM that has exited file = sled-agent/src/instance.rs:817 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
27982025-01-17T08:34:40.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
27992025-01-17T08:34:40.972ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 1803422992759456587 n_samples = 6 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28002025-01-17T08:34:40.972ZINFOSledAgent (StorageManager): Received GetLatestResources(...) file = sled-storage/src/manager.rs:607
28012025-01-17T08:34:40.972ZWARNSledAgent (kstat-sampler-worker): target removed with queued samples file = oximeter/instruments/src/kstat/sampler.rs:602 id = 18151778821393870019 n_samples = 6 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28022025-01-17T08:34:40.972ZINFOSledAgent (ZoneBundler): creating zone bundle context = ZoneBundleContext { storage_dirs: ["/pool/int/42fa09d5-c2a2-4406-a17f-decf2d82447f/debug/bundle/zone", "/pool/int/a43cfd5f-429f-4cbf-a67a-3a5aec478829/debug/bundle/zone"], cause: TerminatedInstance, extra_log_dirs: ["/pool/ext/028b6e25-416e-42c3-8d32-3331a24bdea1/crypt/debug", "/pool/ext/0f4e45ca-0c5e-4431-a74e-c13592f9c739/crypt/debug", "/pool/ext/0ab7c39f-5947-4112-8347-2ecc105352ff/crypt/debug", "/pool/ext/7334e89a-2cf5-468f-9abc-bbdb79aae52f/crypt/debug", "/pool/ext/50ae3ebe-f6db-4363-9ce2-1b7bceae052b/crypt/debug", "/pool/ext/77842ceb-2fab-4804-a283-1a7c8f995913/crypt/debug", "/pool/ext/fe0ed486-6afd-47a9-af7c-1e4fbb9ce5ab/crypt/debug", "/pool/ext/053808f0-a6b0-465b-8cf3-e8a8ce7f5ded/crypt/debug", "/pool/ext/808a66ec-46e9-4cf6-85b9-8ffbd6027ec0/crypt/debug"] } file = sled-agent/src/zone_bundle.rs:339 zone_name = oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382
28032025-01-17T08:34:41.583ZINFOSledAgent (ZoneBundler): finished zone bundle file = sled-agent/src/zone_bundle.rs:1142 metadata = ZoneBundleMetadata { id: ZoneBundleId { zone_name: "oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382", bundle_id: 1adc62c1-d2cc-4356-bdcf-509420f5e03c }, time_created: 2025-01-17T08:34:40.972970880Z, version: 0, cause: TerminatedInstance }
28042025-01-17T08:34:41.583ZWARNSledAgent (InstanceManager): Halting and removing zone: oxz_propolis-server_8dc274bd-acbb-41c1-8419-e1186e06c382 file = sled-agent/src/instance.rs:1314 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
28052025-01-17T08:34:41.800ZINFOSledAgent (dropshot (BootstrapAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 remote_addr = [fdb0:18c0:4d0d:a02a::2]:49130
28062025-01-17T08:34:41.800ZINFOSledAgent (dropshot (BootstrapAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 150 local_addr = [fdb0:18c0:4d0d:a02a::1]:80 method = GET remote_addr = [fdb0:18c0:4d0d:a02a::2]:49130 req_id = 3441ccb7-ac91-439b-a7ee-b05ca0eeac6f response_code = 200 uri = /baseboard
28072025-01-17T08:34:42.327ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:37080
28082025-01-17T08:34:42.379ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:40943
28092025-01-17T08:34:42.379ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 47 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:40943 req_id = 6fe5fefd-f3ac-4817-9664-3985902a6263 response_code = 200 uri = /vpc-routes
28102025-01-17T08:34:42.424ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {60f23a6c-0eab-437e-b374-a5b99b9e0d54: {10.151.2.175: {8abf940b-896d-46ba-8103-17a071fd4f76}, 10.151.2.176: {8abf940b-896d-46ba-8103-17a071fd4f76}}} }
28112025-01-17T08:34:42.424ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 110 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40943 req_id = 586188c3-4e26-4594-a08e-a22c4cf1eab3 response_code = 204 uri = /eip-gateways
28122025-01-17T08:34:42.439ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 252 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:40943 req_id = 905d2be9-d71a-43d9-95dc-ca0a7d813378 response_code = 204 uri = /vpc-routes
28132025-01-17T08:34:42.473ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:64383
28142025-01-17T08:34:42.473ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28152025-01-17T08:34:42.512ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28162025-01-17T08:34:42.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95494 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::a]:64383 req_id = 81dda8cb-6edb-4429-8bfd-13a42defd628 response_code = 204 uri = /switch-ports
28172025-01-17T08:34:42.569ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:57877
28182025-01-17T08:34:42.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 225 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:64383 req_id = b6e5affa-3dc1-4c16-a26c-a401d0ac9a30 response_code = 200 uri = /network-bootstore-config
28192025-01-17T08:34:42.569ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 217 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:57877 req_id = b113deee-2f6a-485f-810e-5954df00c3c7 response_code = 200 uri = /v2p
28202025-01-17T08:34:43.331ZINFOSledAgent (InstanceManager): halt_and_remove_logged: Previous zone state: Running file = illumos-utils/src/zone.rs:279 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
28212025-01-17T08:34:43.348ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(16430372), kind: System }
28222025-01-17T08:34:43.348ZINFOSledAgent (PortManager): Removed route set for subnet file = illumos-utils/src/opte/port_manager.rs:1000 id = RouterId { vni: Vni(16430372), kind: Custom(V4(Ipv4Net { addr: 172.30.0.0, width: 22 })) }
28232025-01-17T08:34:43.348ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T08:34:43.348813468Z }, migration_in: None, migration_out: None }
28242025-01-17T08:34:43.417ZINFOSledAgent (InstanceManager): Publishing instance state update to Nexus file = sled-agent/src/instance.rs:700 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382 state = SledVmmState { vmm_state: VmmRuntimeState { state: Destroyed, gen: Generation(8), time_updated: 2025-01-17T08:34:43.348813468Z }, migration_in: None, migration_out: None }
28252025-01-17T08:34:43.421ZINFOSledAgent (InstanceManager): State monitoring task complete file = sled-agent/src/instance.rs:1251 instance_id = fe4e411b-6385-4535-894a-f7e7e7ac5d5f propolis_id = 8dc274bd-acbb-41c1-8419-e1186e06c382
28262025-01-17T08:34:43.453ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 1125176 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:37080 req_id = d6f2f6f0-a19b-4413-819f-7917ee1ad559 response_code = 200 uri = /vmms/8dc274bd-acbb-41c1-8419-e1186e06c382/state
28272025-01-17T08:34:44.052ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:43451
28282025-01-17T08:34:44.052ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 98 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:43451 req_id = 041bdd45-72a3-42ac-b4f4-c21f6026b173 response_code = 200 uri = /vpc-routes
28292025-01-17T08:34:44.098ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
28302025-01-17T08:34:44.098ZINFOSledAgent: IGW mapping changed; external IPs refreshed file = sled-agent/src/sled_agent.rs:1259 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e
28312025-01-17T08:34:44.099ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 169 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43451 req_id = a02c5870-f311-432a-80e8-d11a1973ede6 response_code = 204 uri = /eip-gateways
28322025-01-17T08:34:44.109ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 331 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::a]:43451 req_id = 436ac7cf-c962-4411-801f-2b86d4782e98 response_code = 204 uri = /vpc-routes
28332025-01-17T08:34:44.166ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::a]:44836
28342025-01-17T08:34:44.166ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 127 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::a]:44836 req_id = 4c79332d-5e58-47f2-a5b6-88b8cc0a6ec5 response_code = 200 uri = /v2p
28352025-01-17T08:34:44.251ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43921
28362025-01-17T08:34:44.251ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 39 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43921 req_id = 0574b339-d0ea-42f3-b2d3-95069ceacf62 response_code = 200 uri = /vpc-routes
28372025-01-17T08:34:44.278ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:51956
28382025-01-17T08:34:44.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 168 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:51956 req_id = bbf57d57-d8f6-4123-ab87-8431c162cdf8 response_code = 200 uri = /v2p
28392025-01-17T08:34:44.278ZINFOSledAgent (PortManager): Mapping virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:874 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(16430372) }
28402025-01-17T08:34:44.278ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 80 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:51956 req_id = 2bc31ca4-f0a3-4ecb-9da7-56166116f76b response_code = 204 uri = /v2p
28412025-01-17T08:34:44.298ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
28422025-01-17T08:34:44.298ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43921 req_id = f44cdd19-f5a1-4f19-94e2-a583aa976690 response_code = 204 uri = /eip-gateways
28432025-01-17T08:34:44.307ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 186 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:43921 req_id = 8c32cc14-e563-4fff-8b75-027adfbdc3ce response_code = 204 uri = /vpc-routes
28442025-01-17T08:34:44.396ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:43501
28452025-01-17T08:34:44.396ZINFOSledAgent (ServiceManager): ensuring scrimlet uplinks file = sled-agent/src/services.rs:4128
28462025-01-17T08:34:44.434ZINFOSledAgent (ServiceManager): setting up port_qsfp0 file = sled-agent/src/services.rs:4152
28472025-01-17T08:34:44.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 95788 local_addr = [fd00:1122:3344:101::1]:12345 method = POST remote_addr = [fd00:1122:3344:101::b]:43501 req_id = a59d6e2a-e7db-45c4-8860-41aad9ac869f response_code = 204 uri = /switch-ports
28482025-01-17T08:34:44.492ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 114 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:43501 req_id = d7e447b4-d9cb-4bb4-bdc3-7ecd69954847 response_code = 200 uri = /network-bootstore-config
28492025-01-17T08:34:44.530ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:44613
28502025-01-17T08:34:44.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 170 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:44613 req_id = 315bd4e9-1429-4672-ae95-10ba2406a389 response_code = 200 uri = /v2p
28512025-01-17T08:34:44.530ZINFOSledAgent (PortManager): Clearing mapping of virtual NIC to physical host file = illumos-utils/src/opte/port_manager.rs:914 mapping = VirtualNetworkInterfaceHost { virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), physical_host_ip: fd00:1122:3344:101::1, vni: Vni(16430372) }
28522025-01-17T08:34:44.530ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 106 local_addr = [fd00:1122:3344:101::1]:12345 method = DELETE remote_addr = [fd00:1122:3344:101::b]:44613 req_id = 9a1cbd08-4c4d-4c9a-be4a-9e0290dc4561 response_code = 204 uri = /v2p
28532025-01-17T08:34:44.769ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:41341
28542025-01-17T08:34:44.769ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 78 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:41341 req_id = 32d9ff18-b751-49fc-8827-0bca8aa071e7 response_code = 200 uri = /vpc-routes
28552025-01-17T08:34:44.784ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
28562025-01-17T08:34:44.784ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 75 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41341 req_id = ea099688-e04a-4eb2-8a0c-d0cc8b037656 response_code = 204 uri = /eip-gateways
28572025-01-17T08:34:44.792ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 204 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:41341 req_id = f5aa47a3-315d-4995-bef1-ad5929b183a9 response_code = 204 uri = /vpc-routes
28582025-01-17T08:34:45.498ZINFOSledAgent (dropshot (SledAgent)): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:1025 local_addr = [fd00:1122:3344:101::1]:12345 remote_addr = [fd00:1122:3344:101::b]:58554
28592025-01-17T08:34:45.498ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 37 local_addr = [fd00:1122:3344:101::1]:12345 method = GET remote_addr = [fd00:1122:3344:101::b]:58554 req_id = e4a2847a-5be3-45af-8b2b-92e9fa03b196 response_code = 200 uri = /vpc-routes
28602025-01-17T08:34:45.512ZINFOSledAgent: IGW mapping received file = sled-agent/src/sled_agent.rs:1233 sled_id = fbac3378-7daf-4aef-b0f5-d2cd5264f30e values = ExternalIpGatewayMap { mappings: {} }
28612025-01-17T08:34:45.512ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 45 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58554 req_id = a561775e-3ec5-42db-9235-6c51ebf54720 response_code = 204 uri = /eip-gateways
28622025-01-17T08:34:45.520ZINFOSledAgent (dropshot (SledAgent)): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.15.1/src/server.rs:867 latency_us = 179 local_addr = [fd00:1122:3344:101::1]:12345 method = PUT remote_addr = [fd00:1122:3344:101::b]:58554 req_id = 27360848-6ba2-45c9-8ff5-97af0622be90 response_code = 204 uri = /vpc-routes